Debugging Collections, Streams and Watch Renderers

Shai Almog - Apr 5 '22 - - Dev Community

In the last two ducklings, I finished the extensive discussion on breakpoints and switched my focus to the watch area. In it, we have several amazing and lesser known tools that let us build insight into our running application. Being able to tell at a glance if something works correctly is crucial for many applications.

This is very important for collections and arrays. We can have thousands or millions of elements within a collection. Debugging this is very difficult without some basic tools.

Collections, Arrays and Streams

Debugging collections (lists, maps etc.) and arrays is painful. You need to dig through results or place conditional breakpoints in for loops. Thatā€™s all painful. There are better solutionsā€¦

Filtering Collections

I talked about a different type of filters a couple of weeks ago, so please donā€™t confuse the two. There are many filter types. Here, they apply to the collections and arrays.

This is a minor feature thatā€™s actually on by default. Yet most developers donā€™t even notice it. When you expand an array of objects, you might have noticed that the IDE hides null values. This is a filter thatā€™s on by default, you can also add your ownā€¦

filter-1.png

We can start by selecting an array or collection in the watch and right clicking it. Then clicking the ā€œFilterā€ option.

filter-2.png

We can then input any condition we want where ā€œthisā€ stands for the current element. When we press enter, the filter will be applied and weā€™ll only see the applicable elements. Notice that in this case, I used method calls and their results as part of the filter.

filter-3.png

Here we see the filter in action. We can clear it by pressing the ā€œclearā€ button next to it. We can edit it by clicking on it too.

Stream Debugger

While I use the Java 8 stream API frequently, I still prefer the old for loops for most cases. The reason for this is debugging. Loops are just inherently easier to debug. It doesnā€™t mean we canā€™t debug streams, but itā€™s often more challenging and requires more wiggling.

JetBrains understood that problem and introduced the stream debugger, initially as a plugin and currently as a built-in tool in the IDE. You can see the button to launch the stream debugger when the current breakpoint is stopped on a stream.

stream-debugger-1.png

When you press this button, the stream debugger is launched. Itā€™s one tool where watching the video will probably explain it better, but Iā€™ll tryā€¦

stream-debugger-2.png

This tool represents every stream function as a stage. You can go back and forth between the stages where you can see how elements in one stage map to their counterparts in the next stage. E.g. a map operation can convert the type of element to a new type. So you would see the elements before the mapping and an arrow to the post mapping instance.

Notice that all the elements are ā€œliveā€ and you can inspect everything as you can with normal inspection in the watch.

Renderers

We normally look at elements in the watch area without giving it too much thought. Thatā€™s the ā€œobjectā€ or the dataā€¦

But what we see is the way a renderer interprets the data. The default behavior for renders in Java is to invoke the toString() method. So while customizing this helps, thereā€™s a lot more that a good renderer can accomplishā€¦

In fact, next week's duckling will dig even deeper into this subject.

Mute Renderers to Speed Up Debugging

Donā€™t you just hate unresponsive debugging?

Pressing step over and just waiting forever for something to happen is very frustrating.

There are many reasons a debugger can be slow. Some of them relate to the application weā€™re debugging, but quite a few of them relate to features we turn on/off. Renderers fall into this category. They can be VERY expensive when we have many watch elements or if the process for rendering them is slow.

mute-renderers-1.png

Luckily JetBrains provides a simple workaround: mute renderers. You can enable this by right clicking on the watch area.

mute-renderers-2.png

Once we mute the renderers, they appear as a short form rendering. Just the object ID next to a button. Clicking on this entry automatically performs the rendering lazily. In this case, the rendering will just invoke the toString() method, as indicated here.

mute-renderers-3.png

Once clicked, we can see the correct value in the renderer and we can inspect the result only for this value. Other values might still be ā€œunrenderedā€.

Renderer Customization

toString() is great for many things, but it might not represent what we want to know about an object. Especially 3rd party objects where we canā€™t control the toString() implementation for cases where performance is an issue. toString() must be efficient since we might use it when logging an object in production. We canā€™t overburden it with data.

custom-rendering-1.png

The ā€œCustomize Data Viewsā€¦ā€ menu item launches the renderer customization menu. This is a pretty powerful feature that lets us control many nuanced capabilities in the default renderer.

custom-rendering-2.png

There are many options in this dialog that let you customize the way elements are rendered in the watch. One of my favorite options is the one to show hex values for integers, which is pretty useful for some of the low level stuff I do.

Here you can uncheck the hide null elements in arrays and collections option we discussed in the filter section above. You can also limit the toString() behavior to specific objects.

Type Renderer

For simple cases, toString() works really well. But there are complex cases where our ability to affect the rendering logic can make a vast difference. Case in point, Spring Boots JPA Repositories. These are interfaces that abstract the underlying database as a set of CRUD operations. A detailed toString() method will be expensive. It can trigger SQL queries, which isnā€™t something weā€™d want to do normally.

But when we debug, this might be pretty valuable.

custom-rendering-3.png

First off, we need to select the right type for renderer. Notice you can use a base type to select the appropriate objects. In this case, JpaRepository is the base interface. By using the expression:

"JPA Repository with " + count() + " elements"
Enter fullscreen mode Exit fullscreen mode

We effectively invoke the count() method on the object thatā€™s rendered. This will probably result in an SQL call to the underlying database, but that might be performant enough during regular debugging.

Notice we can check the ā€œOn-demandā€ flag to make the rendering behave similarly to muted renderers, so it will only render on click.

For elements that support expanding, we can use additional expressions to fetch the full set of data. Here, I use findAll() to list the elements that IntelliJ will show upon expansion. I also use count() > 0 to indicate that the list is expandable.

As you can see, the top repository is a JPA repository. The one below isnā€™t. The top repository is easy to understand at a glance and we can inspect every element in the database instantly. Thatā€™s remarkably powerful!

Notice that the video above doesnā€™t yet cover the last portion here. I ran out of time there. Next weekā€™s video will cover that and an additional interesting renderer feature.

Summary

Showing the right information in the watch is crucial. We can get a sense of whatā€™s going on in an instant!

Debugging can fail over stupid things:

  • Too much information
  • Too little information
  • Information we need to dig through deep hierarchies to find

We can resolve these things with the techniques I discuss above. If you get your watch section in order, your debugging sessions will become far more fluent.

In the next installment, I will teach you how to make the debugging sessions of your entire team more fluentā€¦

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .