Spatial reasoning, also called spatial awareness, is the ability to understand objects in two and three-dimensional terms and draw conclusions about them with limited information. Right now LLMs are struggling in this area. Nathan Bos shared his findings based on the tests he conducted. If you want to feel proud to be a human then you should read this article 😉. Jokes apart, it's an interesting article it will give an idea of where LLMs are struggling, improving and doing a great job.

Language Models and Spatial Reasoning: What’s Good, What Is Still Terrible, and What Is Improving | by Nathan Bos, Ph.D. | Jul, 2024 | Towards Data Science

A review of capabilities as of July 2024

towardsdatascience.com