September 1: Benchmark Run

This is the September 2026 AI benchmark run. Same Chicago real estate questions, same three models, answers recorded exactly as returned — which is the only way a month-to-month comparison means anything.

Joe Bjorklund, September 1, 2026

Welcome to the second of 12 posts to watch the AI responses from the three big AI platforms respond to the exact question over a year. These are the responses from each AI platform and exact cut and paste is highlighted in blue

QUESTION 1: If you were planning to buy a home in the City of Chicago today, would you buy now or wait six months? Explain the most important reasons for your decision.

Claude Response: Buy now. Chicago’s median home price climbed 13% year over year to $425,000 in July, the sharpest increase among the 40 largest U.S. metros, while active listings sit roughly 56% below 2019 levels and homes are moving in about 47 days (Axios). That combination of rising prices and thin supply makes waiting six months a bet that mortgage rates drop enough to offset further appreciation, or that sellers suddenly loosen their grip — neither looks likely this fall. Freddie Mac’s 30-year fixed averaged 6.66% in late August (Freddie Mac), high enough to sting affordability, but rates easing into the low 6% range wouldn’t undo several more months of Chicago’s price growth, especially in competitive North Side neighborhoods. The bigger risk of waiting is walking into the spring 2027 selling season, historically Chicago’s most competitive stretch, with less inventory and more buyers. If you can handle today’s payment and plan to hold at least five to seven years, locking in now and refinancing later if rates fall is the stronger position.

•

QUESTION 2: If you had a budget of $1.5 million to buy a primary residence in Chicago today, which three neighborhoods would you consider first? Explain what you could realistically expect to buy in each one and identify the principal compromise.

Claude Response: West Loop, Lincoln Park and Logan Square, in that order. In West Loop, $1.5 million buys a large, high-end new-construction condo or timber loft — three bedrooms, garage parking, top-tier finishes — but essentially no detached homes, and real exposure to rising HOA dues and special assessments in a still-densifying market with more supply coming online each year. In Lincoln Park, the same budget sits above the neighborhood’s roughly $885,000 median, so it realistically buys a well-updated vintage single-family home or greystone, though probably not on the most sought-after blocks near the park and lake, and often with a smaller footprint than buyers expect at this price (Redfin). In Logan Square, $1.5 million goes the furthest of the three: a fully renovated single-family home with a real yard, or new construction, in a neighborhood still completing its transition from affordable to established. The trade-off there is a shorter track record of price stability, more block-to-block variation in quality, and a commercial corridor still filling in compared to Lincoln Park’s maturity.

•

QUESTION 3: Which type of Chicago property appears to offer the best combination of lifestyle, resale potential and long-term value today: a downtown condominium, a neighborhood condominium, a townhome or a single-family home? Choose one and explain your reasoning.

Claude Response: Townhome. Chicago’s single-family homes are appreciating fastest of any segment — median prices up 13% year over year citywide — which is exactly why they’re becoming the least accessible entry point for most buyers at this budget (Axios). A townhome captures most of what makes a single-family home desirable — a private entrance, multiple floors, often a small yard or garage — without the shared-building governance and special-assessment risk that weighs on condo resale, particularly in older mid-rise buildings with underfunded reserves. Townhome inventory also grew faster than any other segment this year, up more than 7% annually, meaning buyers actually have room to choose rather than compete for scraps (Axios). Downtown condos remain the weakest of the four on pure appreciation, with median price growth around 4% year over year versus double digits in townhome-heavy North Side pockets (Redfin). For a buyer optimizing lifestyle and resale together, the townhome is the more attainable, lower-risk version of the single-family case.

AI MODEL: Claude Sonnet 5 (Anthropic)
DATE ANSWERED: 2026-09-01
WEB SEARCH USED: Yes

____________________

QUESTION 1: If you were planning to buy a home in the City of Chicago today, would you buy now or wait six months? Explain the most important reasons for your decision.

Gemini Response: I would buy now rather than waiting six months. With Chicago’s median home sale price sitting around $430,000 — up over 7% year-over-year — and inventory tightly constrained at under three months of supply, delaying your purchase will likely cost you more in purchase price than you might gain in rate relief. Mortgage rates have remained stubborn above 6.5%, meaning waiting until late winter or early spring 2027 will not yield significant borrowing savings (Dee Savic). Furthermore, Chicago’s housing market enters its seasonal winter slowdown during the next six months. Buying in late summer or early autumn allows you to take advantage of lingering inventory before fresh inventory drops significantly in late Q4 (Option Premier). Sellers currently active are often motivated to close before the holiday season, giving buyers stronger leverage for price negotiations and seller concessions. Waiting six months places you right into the ultra-competitive spring market when buyer demand spikes, pushing list-to-sale price ratios back over 100% and triggering multiple-offer scenarios. Capitalizing on today’s relative negotiating leverage avoids paying higher entry prices next year.

•

QUESTION 2: If you had a budget of $1.5 million to buy a primary residence in Chicago today, which three neighborhoods would you consider first? Explain what you could realistically expect to buy in each one and identify the principal compromise.

Gemini Response: Lincoln Park: You can expect to buy an updated, historic 3-to-4 bedroom rowhome, a high-end duplex condo, or a smaller vintage single-family home on a standard lot. The principal compromise is sacrificing square footage and outdoor space compared to other neighborhoods, alongside paying higher Cook County property taxes (Opendoor). West Loop: You can easily secure a sprawling, luxury 3-bedroom timber loft or modern mid-rise condominium with high-end finishes and garage parking. The main compromise is the near-total lack of detached single-family homes or private yard space, along with higher HOA fees and a commercial neighborhood environment. North Center: A $1.5 million budget buys a spacious, detached 4-to-5 bedroom single-family home with a full yard and garage, located within top-ranked public school districts like Coonley or Bell (Opendoor). The principal compromise is a longer commute to downtown Chicago and less immediate access to nightlife compared to Lincoln Park or West Loop.

•

QUESTION 3: Which type of Chicago property appears to offer the best combination of lifestyle, resale potential and long-term value today: a downtown condominium, a neighborhood condominium, a townhome or a single-family home? Choose one and explain your reasoning.

Gemini Response: A single-family home offers the best combination of lifestyle, resale potential, and long-term value in Chicago. From a financial standpoint, single-family homes hold land value in a city where buildable lots are finite. Unlike downtown or neighborhood condominiums, single-family properties are immune to escalating special assessments, unpredictable HOA fees, and rental caps that frequently hamper condo resale value and buyer pools (Dee Savic). Demand for detached homes in North Side neighborhoods (such as Lakeview, North Center, and Lincoln Square) remains perpetually high, driven by families seeking space and strong school districts. This tight supply guarantees robust price appreciation and superior liquidity during market downturns compared to multi-unit options. Lifestyle-wise, single-family homeownership eliminates shared walls, providing complete control over maintenance, architectural modifications, and private outdoor yard space. While neighborhood condos offer lower entry price points, the long-term value trajectory and asset control of a single-family home make it the premier housing stock choice in the city.

AI MODEL: Gemini
DATE ANSWERED: September 1, 2026
WEB SEARCH USED: Yes

____________________

QUESTION 1: If you were planning to buy a home in the City of Chicago today, would you buy now or wait six months? Explain the most important reasons for your decision.

Chat GPT Response: I would buy now rather than wait six months. Chicago’s problem is not weak demand; it is limited supply. Realtor.com reported that active Chicago listings in July were down 7.0% year over year, while new listings were down 5.5%, and the median list price rose 4.1% to $392,500. Homes were moving in a median 35 days (Realtor.com). Redfin’s neighborhood data show the pressure is even stronger in desirable North Side areas: Lincoln Park’s median sale price was up 16.4% year over year, Lake View 8.3%, and West Town 8.9% (Redfin). Waiting for a broad price decline therefore looks like a poor bet. The argument for waiting is mortgage rates: Freddie Mac’s latest 30-year fixed average is 6.66%, high enough to meaningfully affect affordability (Freddie Mac). But six months is too short a window to gamble on both lower rates and lower Chicago prices. If rates fall, demand could strengthen and offset part of the financing benefit through higher prices or more bidding competition. I would buy a home I expected to hold at least seven years and refinance later if rates improve.

•

QUESTION 2: If you had a budget of $1.5 million to buy a primary residence in Chicago today, which three neighborhoods would you consider first? Explain what you could realistically expect to buy in each one and identify the principal compromise.

Chat GPT Response: My first three choices would be Lincoln Park, Lake View and West Town. In Lincoln Park, $1.5 million can realistically buy a high-end three- or four-bedroom condominium, a townhome, or an older/smaller single-family home away from the most expensive blocks. The neighborhood’s median sale price was about $885,000 in the three months ending June, but competition is intense: Redfin reports 69.2% of homes sold above list price (Redfin). The compromise is that $1.5 million no longer guarantees a large detached house. In Lake View, the same budget stretches further. With a neighborhood median around $595,000, I would expect a substantial newer condo, a townhome, or a credible single-family option, especially west of the lakefront (Redfin). The compromise is giving up some of Lincoln Park’s prestige and proximity to downtown. In West Town, I would target a modern single-family home, newer luxury condo, or townhome around Wicker Park/Ukrainian Village. Its median was roughly $730,000, up 8.9% year over year (Redfin). The compromise is less lake access and a more block-by-block neighborhood feel.

•

QUESTION 3: Which type of Chicago property appears to offer the best combination of lifestyle, resale potential and long-term value today: a downtown condominium, a neighborhood condominium, a townhome or a single-family home? Choose one and explain your reasoning.

Chat GPT Response: I would choose a single-family home. In Chicago today, detached houses in established city neighborhoods offer the strongest combination of lifestyle, resale potential and long-term scarcity. They provide what many buyers eventually want but cannot easily add to a condominium: private outdoor space, multiple levels, storage, parking potential and freedom from shared-building governance. The value case is scarcity. Chicago can create more condominium inventory by converting or constructing multifamily buildings, especially downtown, but it is much harder to create additional single-family lots in built-out neighborhoods such as Lincoln Park, Lake View, North Center, Roscoe Village or parts of West Town. That limited supply matters in a market where Chicago listings are already constrained: Realtor.com reported active listings down 7.0% year over year in July (Realtor.com). A downtown condominium can offer exceptional space and views for the money, but downtown’s median price growth was only 4.0% year over year, versus 16.4% in Lincoln Park and 8.3% in Lake View (Redfin). The principal drawback to single-family ownership is price: entry costs, taxes and maintenance are substantially higher.

AI MODEL: ChatGPT (GPT-5.6 Sol)
DATE ANSWERED: September 1, 2026
WEB SEARCH USED: Yes


More in this series

Missed last month? Read August 1’s Benchmark Run, or see the full methodology behind this series in Benchmarking Chicago Real Estate AI.

Curious how these AI models actually work under the hood? Our AI Reference Papers cover the technology behind these answers: Embeddings Explained, Large Language Models Explained, Retrieval-Augmented Generation (RAG), and Building Real Estate Websites That AI Can Understand.

Where the September 2026 AI benchmark sits

Leave a Comment

Your email address will not be published. Required fields are marked *

Scroll to Top