AI Lab website: effects A, B and C on 14 Stevens photos

Best three photos for each effect

Effect A: Object Relations

Objects found and outlined by the models, joined by relations measured from their outlines and depth.

torch-bearer 4
One clear subject named part by part, with eight depth relations anyone can check by eye, such as the statue in front of the building.
castle-point-skyline 4
The cannon, its two wheels and the benches carry real depth and inside relations, with Manhattan's towers named across the river.
eas 4
The hall's architecture gets precise names (gothic arch, mansard roof, a dormer inside the roof), and only three tiny zones are masked.

Usable for A (9): eas, torch-bearer, gateway, babbio-night, castle-point-skyline, ucc, ucc-entrance, atrium, plaza

Effect B: Built by the Model

The photo rebuilt from its SAM segments, placed from far to near.

eas 5
Sky, roof, facade, steps and evergreen arrive in order from far to near, and the finished mosaic still reads as the building.
castle-point-skyline 4
Chain posts and cannon wheels stand in front of a dense skyline, so 415 segments build up in clear layers.
campus-view 4
The aerial view runs from the field to the Manhattan skyline, so the build passes through many distinct layers.

Usable for B (9): eas, torch-bearer, gateway, babbio-night, castle-point-skyline, campus-view, ucc, atrium, plaza

Effect C: Depth Cloud

Every pixel as a coloured dot at the distance the depth model estimated.

campus-view 4
The aerial scene stays whole when turned 5 to 12 degrees, and the two towers stand well off the river.
torch-bearer 4
The lit statue stands clear of the building behind it, so even a small turn shows real parallax.
eas 4
The hall and the evergreen separate cleanly and hold together at 20 degrees; only the sky is sparse.

Usable for C (7): eas, torch-bearer, gateway, babbio-night, campus-view, river-nyc, atrium

Usable means a fit of 3 or more with no problem visible in the previews. Commons, gateway-study and staircase suit none of the three effects: the zones masked around people cover their centres and show as flat blocks. Castle-point-skyline and ucc suit A and B, campus-view suits B and C, river-nyc suits only C, and ucc-entrance only A.

All 14 photos

Rows run from the photos usable for all three effects to those usable for none; the two round-03 photos come last for comparison. Column B shows the mosaic half of the segments preview (click it for the full preview with the segment map and coverage). Column C shows four views of the cloud: from the photo’s camera, turned 12 degrees right, turned 20 degrees left and seen from 45 degrees up.

Photo	Object Relations	Built by the Model	Depth Cloud	Fit, 1 to 5
eas round 05 Edwin A. Stevens Hall, front steps up to the DeBaun Auditorium entrance 16 objects, 14 relations (3 depth), 401 segments, 3 zones masked by hand	A Object Relations	B Built by the Model	C Depth Cloud	A4Precise architectural names (gothic arch, mansard roof, a dormer inside the roof) and 3 true depth relations; two labels overlap at the doorway. B5Sky, roofs, facade, steps, hedge and evergreen arrive as distinct layers; the mosaic reads as the building at a glance. C4Turns well to 20 degrees; a dark gap opens behind the evergreen at 12 degrees, and the sky is sparse.
torch-bearer round 05 The Torch Bearer statue on a campus lawn at dusk, with a lit brick building behind 16 objects, 19 relations (8 depth), 256 segments, 2 zones masked by hand	A Object Relations	B Built by the Model	C Depth Cloud	A4Statue, pedestal, plaque and flower bed named, with 8 depth relations (statue in front of the building). B4Clean layers from sky to building to statue; the lawn arrives as one big flat piece. C4The statue stands clear of the building; dark gaps open behind it at 12 degrees.
gateway round 05 Gateway Academic Center, the glass bridge between Gateway South Hall and Gianforte Family Hall 16 objects, 17 relations (3 depth), 387 segments, 7 zones masked by hand	A Object Relations	B Built by the Model	C Depth Cloud	A416 well-named objects around the glass bridge with 3 depth relations; labels crowd the lower left corner. B4The mullion grid makes a strong graphic mosaic with clean layers. C3Coherent, but mostly one curved sheet, so a turn shows little parallax.
babbio-night round 05 Babbio Center entrance and riverfront terrace at night, with the Manhattan skyline across the Hudson 16 objects, 19 relations (1 depth), 343 segments, 7 zones masked by hand	A Object Relations	B Built by the Model	C Depth Cloud	A316 good objects across the frame, but 17 of the 19 relations are plain directions, and labels overlap at the doors. B4Sky, skyline, terrace, facade and paving form clean layers. C3Coherent and smear-free; the sky and skyline make one flat far wall.
castle-point-skyline round 05 Castle Point lookout: a cannon, benches and chain railing above the Hudson, Manhattan across the water 16 objects, 15 relations (3 depth), 415 segments, 2 zones masked by hand	A Object Relations	B Built by the Model	C Depth Cloud	A4Cannon, wheels, benches and posts with 3 depth and 3 inside relations; the river and schooner are left out. B4Cannon and chain posts in front, Manhattan behind: clean, striking layers. C1Falls apart: at 12 degrees the cannon and benches are gone and the water is long streaks. Agent’s score: 2.
campus-view round 05 Stevens campus from above: the athletic field and stands, campus buildings, the Hudson and the Manhattan skyline 16 objects, 15 relations (0 depth), 429 segments, 15 zones masked by hand	A Object Relations	B Built by the Model	C Depth Cloud	A216 correct objects across the scene, but all 15 relations are flat directions. B4Field, roofs, towers, river and skyline arrive in clear layers; the field is one big piece. C4A coherent aerial scene at 5 to 12 degrees, with small gaps behind the towers.
ucc round 05 Stevens campus seen from the Hudson at dusk: the University Center Complex towers above the waterfront pier 15 objects, 17 relations (4 depth), 299 segments, 15 zones masked by hand	A Object Relations	B Built by the Model	C Depth Cloud	A3Towers, flags, lamps and the river with 4 depth relations; most objects are small waterfront details. B3Clear far-to-near layers, but the sky, the tower glass and the river are large flat fills. Agent’s score: 4. C2The sky breaks into blocks with dark holes at 12 degrees, and the towers turn into flat slabs.
river-nyc round 05 The Hudson from the Hoboken waterfront: Stevens towers at left, the Manhattan skyline at right 16 objects, 19 relations (0 depth), 290 segments, 5 zones masked by hand	A Object Relations	B Built by the Model	C Depth Cloud	A2Objects sit only at the left and right edges, labels crowd at the left, and there is no depth relation. Agent’s score: 3. B2Sky and water are one segment each, so the build has few layers. C3A clean, smear-free water plane, but a simple scene.
ucc-entrance round 05 University Center entrance on a spring day, with a glass tower and the campus walk behind 16 objects, 18 relations (1 depth), 284 segments, 11 zones masked by hand	A Object Relations	B Built by the Model	C Depth Cloud	A3Specific names (lettering, canopy, plaque, manhole cover), but only 1 depth relation. B2The foreground walkers' zone fills as one large taupe wedge in front of the steps, and the lettering breaks up. Agent’s score: 3. C2The filled walker zones open straight-edged dark bands on the steps when the cloud turns. Agent’s score: 3.
commons round 05 Campus commons with a window wall onto trees and the river, a stone wall carved with the Stevens seal, and a red service counter 13 objects, 15 relations (3 depth), 264 segments, 8 zones masked by hand	A Object Relations	B Built by the Model	C Depth Cloud	A2The seal wall, railing, bench and counter touch zones, so the 13 objects sit at the edges. B2Clear layers, but the filled zones stand as tall flat blocks by the seal wall and the counter. Agent’s score: 3. C2The counter zones show as a blocky patch, and large gaps open behind the seal wall at 12 degrees. Agent’s score: 3.
gateway-study round 05 Study corridor with lounge chairs, a tall window and an old brick wall, Gateway Academic Center 14 objects, 16 relations (2 depth), 256 segments, 7 zones masked by hand	A Object Relations	B Built by the Model	C Depth Cloud	A2The centre is masked, so the 14 objects are small and pushed to the left. B2The filled zones become large flat polygons in the middle of the mosaic. C2The same zones show as flat blocks in the cloud.
staircase round 05 Campus staircase with tiled seating steps, steel handrails, a red wall and glass doors 10 objects, 12 relations (0 depth), 236 segments, 8 zones masked by hand	A Object Relations	B Built by the Model	C Depth Cloud	A1The steps and handrail are excluded; the 10 objects all sit in the far doorway corner. B2The tread stripes read well, but large flat polygons fill the zones by the rail and the doorway. Agent’s score: 3. C2The most 3D interior, but 15% of the photo is filled zone, and a large dark hole opens at 12 degrees. Agent’s score: 3.
atrium round 03 Babbio Center atrium, glass wall onto the Hudson and the Manhattan skyline 16 objects, 18 relations (7 depth), 386 segments, 7 zones masked by hand	A Object Relations	B Built by the Model	C Depth Cloud	A4The photo PA uses now: 16 objects with 7 depth relations through the glass; labels crowd the centre. B3A busy mosaic of mullions; everything beyond the glass sits at one depth. C3The cloud PC uses now: readable from the camera, with large gaps behind the column when turned.
plaza round 03 Babbio Center entrance plaza at dusk 16 objects, 18 relations (5 depth), 336 segments, 0 zones masked by hand	A Object Relations	B Built by the Model	C Depth Cloud No cloud computed	A4Canopy, revolving door, benches, columns and shrub with 5 depth relations. B4The photo PB uses now: the facade panels and the shrub give a readable build. Cn/aNo cloud was computed for this photo in round 03.