Design Arena

LeWitt Bench

Inspired by Sol LeWitt's instruction-based wall drawings.

This project was inspired by and initially based on lewitt_instructions by Maximal Margin, dated Oct. 15th, 2023. We're grateful to Maximal Margin for her invitation to build on her foundational work ♥️

Instruction-based Art

"Influenced by his time working in an architect's office, LeWitt would use assistants to produce three-dimensional works he called 'structures.' He wrote: 'An architect doesn't go off with a shovel and dig his foundation and lay every brick. He's still an artist.'"

Instead of executing the works of art himself, LeWitt comes up with an idea or plan for his art, usually a set of simple instructions—sometimes with line drawings. He then hands over the written plan to his assistants, and they construct the work.

— From Sol LeWitt's Concepts and Structures (National Gallery of Art)

Examples of Sol LeWitt instruction-based art generations by various AI models

Instruction-based art offers a rare opportunity to test models' ability to follow explicit, rule-based instructions—a core but often overlooked aspect of visual reasoning. We build upon Maximal Margin's 2023 study to explore how faithfully models execute instructions in the domain of visual art and reveal whether technical progress has led to genuine compositional improvement.

The resulting LeWitt-Bench is a crowdsourced, subjective benchmark that collects human consensus—a noisy but critical vector of measuring what makes "good art". A post-analysis will be conducted comparing live, subjective results against the verifiable domain of prompt adherence, marking a structured attempt to evaluate a non-verifiable task. Our motivation to create this benchmark can be found here.

About the Dataset

This benchmark includes 28 instruction-image pairs from Sol LeWitt's instruction-based art, sourced from Sol LeWitt: A Wall Drawing Retrospective, which comprises 105 of LeWitt's large-scale wall drawings spanning 1969 to 2007.

Vote for Your Favorite

Click "Vote as Favorite" to reveal the creators.

#11

A wall divided horizontally and vertically into four equal parts. Within each part, three of the four kinds of lines are superimposed.

Not available

#16

Bands of lines 12 inches (30 cm) wide, in three directions (vertical, horizontal, diagonal right) intersecting.

Not available

#17

Four-part drawing with a different line direction in each part.

Not available

#19

A wall divided vertically into six equal parts, with two of the four kinds of line directions superimposed in each part.

Not available

#38

Tissue paper cut into 1½-inch (4 cm) squares and inserted into holes in the gray pegboard walls. All holes in the walls are filled randomly.

Not available

#47

A wall divided into fifteen equal parts, each with a different line direction, and all combinations.

Not available

#51

All architectural points connected by straight lines.

Not available

#56

A square is divided horizontally and vertically into four equal parts, each with lines in four directions superimposed progressively.

Not available

#85

A wall is divided into four horizontal parts. In the top row are four equal divisions, each with lines in a different direction. In the second row, six double combinations; in the third row, four triple combinations; in the bottom row, all four combinations superimposed.

Not available

#88

A 6-inch (15 cm) grid covering the wall. Within each square, not straight lines in either of four directions. Only one direction in each square but as many as desired, and at least one line in each square.

Not available

#142

A 10-inch (25 cm) grid covering the wall. An increasing number of vertical not straight lines from the left side and horizontal not straight lines from bottom to top, adding one line per row of the grid. All lines are spaced evenly based on the number of lines, filling the last row of each direction.

Not available

#159

A black outlined square with a red diagonal line from the lower left corner toward the upper right corner; and another red line from the lower right corner to the upper left.

Not available

#160

A black outlined square with a red diagonal line centered on the axis between the upper left and lower right corners and another red diagonal line centered on the axis between the lower left and upper right corners.

Not available

#164

A black outlined square with a red horizontal line centered on the axis between the midpoint of the left side and the midpoint of the right side and a red diagonal line centered on the axis between the lower left and upper right corners.

Not available

#237

The location of a trapezoid.

Not available

#238

The location of a parallelogram.

Not available

#274

The location of six geometric figures. (The specific locations are determined by the drafter.)

Not available

#289

A 6-inch (15 cm) grid covering each of the four black walls. White lines to points on the grids. Fourth wall: twenty-four lines from the center, twelve lines from the midpoint of each of the sides, twelve lines from each corner. (The length of the lines and their placement are determined by the drafter.) (Detail: 4th wall only)

Not available

#335

On four black walls, white vertical parallel lines, and in the center of the walls, eight geometric figures (including cross, X) within which are white horizontal parallel lines. The vertical lines do not enter the figures.

Not available

#340

Six-part drawing. The wall is divided horizontally and vertically into six equal parts. 1st part: On red, blue horizontal parallel lines, and in the center, a circle within which are yellow vertical parallel lines; 2nd part: On yellow, red horizontal parallel lines, and in the center, a square within which are blue vertical parallel lines; 3rd part: On blue, yellow horizontal parallel lines, and in the center, a triangle within which are red vertical parallel lines; 4th part: On red, yellow horizontal parallel lines, and in the center, a rectangle within which are blue vertical parallel lines; 5th part: On yellow, blue horizontal parallel lines, and in the center, a trapezoid within which are red vertical parallel lines; 6th part: On blue, red horizontal parallel lines, and in the center, a parallelogram within which are yellow vertical parallel lines. The horizontal lines do not enter the figures.

Not available

#386

Stars with three, four, five, six, seven, eight, and nine points, drawn with a light tone India ink wash inside, an India ink wash outside, separated by a 6-inch (15 cm) white band.

Not available

#391

Two-part drawing. The two walls are each divided horizontally and vertically into four equal parts. First wall: 12-inch (30 cm) bands of lines in four directions, one direction in each part, drawn in black India ink. Second wall: Same, but with four colors drawn in India ink and color ink washes.

Not available

#419

The wall is bordered and divided horizontally and vertically into four equal parts with a 6-inch (15 cm) black ink band. Each quarter has alternating parallel 6-inch (15 cm) bands of white and color ink bands. Upper left: gray; upper right: yellow; lower left: red; lower right: blue.

Not available

#462

On four walls, one room, arcs 4 inches (10 cm) wide, from the midpoints of four sides, drawn with alternating bands of gray and black ink wash (Detail: three walls).

Not available

#630

A wall is divided horizontally into two equal parts. Top: alternating horizontal black and white 8-inch (20 cm) bands. Bottom: alternating vertical black and white 8-inch (20 cm) bands.

Not available

#631

A wall is divided into two equal parts by a line drawn from corner to corner. Left: alternating diagonal black and white 8-inch (20 cm) bands from the lower left. Right: alternating diagonal black and white 8-inch (20 cm) bands from the upper right.

Not available

#797

The first drafter has a black marker and makes an irregular horizontal line near the top of the wall. Then the second drafter tries to copy it (without touching it) using a red marker. The third drafter does the same, using a yellow marker. The fourth drafter does the same using a blue marker. Then the second drafter followed by the third and fourth copies the last line drawn until the bottom of the wall is reached.

Not available

#901

Color bands and black blob. The wall is divided vertically into six equal bands; red; yellow; blue; orange; purple; green. In the center is a black glossy blob.

Not available

← Scroll horizontally to see all 12 creations →

Instruction	Creation A	Creation B	Creation C	Creation D	Creation E	Creation F	Creation G	Creation H	Creation I	Creation J	Creation K	Creation L
Wall Drawing 11 A wall divided horizontally and vertically into four equal parts. Within each part, three of the four kinds of lines are superimposed.	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available
Wall Drawing 16 Bands of lines 12 inches (30 cm) wide, in three directions (vertical, horizontal, diagonal right) intersecting.	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available
Wall Drawing 17 Four-part drawing with a different line direction in each part.	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available
Wall Drawing 19 A wall divided vertically into six equal parts, with two of the four kinds of line directions superimposed in each part.	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available
Wall Drawing 38 Tissue paper cut into 1½-inch (4 cm) squares and inserted into holes in the gray pegboard walls. All holes in the walls are filled randomly.	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available
Wall Drawing 47 A wall divided into fifteen equal parts, each with a different line direction, and all combinations.	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available
Wall Drawing 51 All architectural points connected by straight lines.	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available
Wall Drawing 56 A square is divided horizontally and vertically into four equal parts, each with lines in four directions superimposed progressively.	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available
Wall Drawing 85 A wall is divided into four horizontal parts. In the top row are four equal divisions, each with lines in a different direction. In the second row, six double combinations; in the third row, four triple combinations; in the bottom row, all four combinations superimposed.	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available
Wall Drawing 88 A 6-inch (15 cm) grid covering the wall. Within each square, not straight lines in either of four directions. Only one direction in each square but as many as desired, and at least one line in each square.	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available
Wall Drawing 142 A 10-inch (25 cm) grid covering the wall. An increasing number of vertical not straight lines from the left side and horizontal not straight lines from bottom to top, adding one line per row of the grid. All lines are spaced evenly based on the number of lines, filling the last row of each direction.	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available
Wall Drawing 159 A black outlined square with a red diagonal line from the lower left corner toward the upper right corner; and another red line from the lower right corner to the upper left.	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available
Wall Drawing 160 A black outlined square with a red diagonal line centered on the axis between the upper left and lower right corners and another red diagonal line centered on the axis between the lower left and upper right corners.	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available
Wall Drawing 164 A black outlined square with a red horizontal line centered on the axis between the midpoint of the left side and the midpoint of the right side and a red diagonal line centered on the axis between the lower left and upper right corners.	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available
Wall Drawing 237 The location of a trapezoid.	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available
Wall Drawing 238 The location of a parallelogram.	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available
Wall Drawing 274 The location of six geometric figures. (The specific locations are determined by the drafter.)	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available
Wall Drawing 289 A 6-inch (15 cm) grid covering each of the four black walls. White lines to points on the grids. Fourth wall: twenty-four lines from the center, twelve lines from the midpoint of each of the sides, twelve lines from each corner. (The length of the lines and their placement are determined by the drafter.) (Detail: 4th wall only)	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available
Wall Drawing 335 On four black walls, white vertical parallel lines, and in the center of the walls, eight geometric figures (including cross, X) within which are white horizontal parallel lines. The vertical lines do not enter the figures.	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available
Wall Drawing 340 Six-part drawing. The wall is divided horizontally and vertically into six equal parts. 1st part: On red, blue horizontal parallel lines, and in the center, a circle within which are yellow vertical parallel lines; 2nd part: On yellow, red horizontal parallel lines, and in the center, a square within which are blue vertical parallel lines; 3rd part: On blue, yellow horizontal parallel lines, and in the center, a triangle within which are red vertical parallel lines; 4th part: On red, yellow horizontal parallel lines, and in the center, a rectangle within which are blue vertical parallel lines; 5th part: On yellow, blue horizontal parallel lines, and in the center, a trapezoid within which are red vertical parallel lines; 6th part: On blue, red horizontal parallel lines, and in the center, a parallelogram within which are yellow vertical parallel lines. The horizontal lines do not enter the figures.	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available
Wall Drawing 386 Stars with three, four, five, six, seven, eight, and nine points, drawn with a light tone India ink wash inside, an India ink wash outside, separated by a 6-inch (15 cm) white band.	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available
Wall Drawing 391 Two-part drawing. The two walls are each divided horizontally and vertically into four equal parts. First wall: 12-inch (30 cm) bands of lines in four directions, one direction in each part, drawn in black India ink. Second wall: Same, but with four colors drawn in India ink and color ink washes.	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available
Wall Drawing 419 The wall is bordered and divided horizontally and vertically into four equal parts with a 6-inch (15 cm) black ink band. Each quarter has alternating parallel 6-inch (15 cm) bands of white and color ink bands. Upper left: gray; upper right: yellow; lower left: red; lower right: blue.	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available
Wall Drawing 462 On four walls, one room, arcs 4 inches (10 cm) wide, from the midpoints of four sides, drawn with alternating bands of gray and black ink wash (Detail: three walls).	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available
Wall Drawing 630 A wall is divided horizontally into two equal parts. Top: alternating horizontal black and white 8-inch (20 cm) bands. Bottom: alternating vertical black and white 8-inch (20 cm) bands.	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available
Wall Drawing 631 A wall is divided into two equal parts by a line drawn from corner to corner. Left: alternating diagonal black and white 8-inch (20 cm) bands from the lower left. Right: alternating diagonal black and white 8-inch (20 cm) bands from the upper right.	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available
Wall Drawing 797 The first drafter has a black marker and makes an irregular horizontal line near the top of the wall. Then the second drafter tries to copy it (without touching it) using a red marker. The third drafter does the same, using a yellow marker. The fourth drafter does the same using a blue marker. Then the second drafter followed by the third and fourth copies the last line drawn until the bottom of the wall is reached.	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available
Wall Drawing 901 Color bands and black blob. The wall is divided vertically into six equal bands; red; yellow; blue; orange; purple; green. In the center is a black glossy blob.	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available	Image not available

Creator positions are randomized for each instruction to prevent bias