What should my weekly scoreboard look like now that organic sessions don't tell the story?

Swap the organic sessions slide for five numbers you can pull every Monday: floor ups and where they say they started, appointments set, whether AI names your store when you ask it, branded search and direct calls, and closing ratio. Sessions count clicks, and clicks are what AI is absorbing. These five count customers.
Picture the Monday meeting at a store like yours. The vendor's slide says organic sessions are down 18 percent. The sales manager is braced for a bad month. Then somebody reads the deal log and it was a good month. Nothing about the slide was wrong. It just stopped measuring the thing that pays us.
Why did organic sessions stop telling me the truth?
A session happens when a shopper clicks through to your site. More and more shoppers get their answer in the search results or from an AI assistant and never click. They still show up. They just skip the part your analytics can see. I wrote about why a falling traffic line is not always bad news in Your Website Traffic Is Down. That Might Not Be the Bad News You Think It Is. The short version: the funnel moved, and the old chart stayed where it was.
What are the five numbers to put on the scoreboard?
Keep it to one page and one row per week. Here is what goes on it:
- Floor ups, with a source line. Not just how many walked in, but how many say they asked an AI or saw it in a search answer. Your BDC or front desk asks one question at greeting and writes down the answer.
- Appointments set and appointments shown. Both, side by side. A shopper who booked after reading an AI answer tends to show, because they already picked you.
- AI visibility check. Ask ChatGPT, Gemini and Claude the same five questions a shopper would type about your brand and your town. Write down whether you were named, recommended, or missing.
- Branded search and inbound calls. People who heard your name somewhere and then typed it. This is where AI-influenced demand tends to surface.
- Closing ratio on the traffic you do get. When lead counts fall and this number climbs, the shoppers who remain are further along. More on that in Why is my closing ratio going up while my leads go down?
How do I track what AI says about my store each week?
Treat it like a mystery shop. Use the same five prompts every week so the results are comparable. For example: best dealer for my brand near my town, who has the best service department, what does this dealer charge in fees. Screenshot the answers and score each one: named, recommended, missing, or wrong. Four of five named is a good week. Zero is a conversation to have with your team. The measurement approach is laid out in You Can't Forecast What You Can't See, and the monthly cadence there works fine if weekly feels like too much.
What about the lead count my vendor reports?
Keep it, but move it down the page. Lead count is one input, not the scoreboard. If you want the full picture of why it can drop while the store stays busy, read Why Are My Internet Leads Down This Month? and compare it against your floor traffic before you react.
How do I know if the new scoreboard is working?
Run it for six weeks before you judge it. Picture a store that starts asking every up one question at the desk. By week three the manager knows what share of ups arrived after an AI answer, and that single line does more for the budget conversation than any traffic chart ever did. If your six weeks show you missing from the AI answers while competitors get named, the cause is almost always readable signals, not effort. How AI picks a dealership walks through what those signals are and how to check each one.
What do I do with the old slide?
Leave it in the deck as a footnote if your owner or your vendor likes it. Just stop letting it set the mood of the meeting. The scoreboard above gets you out of arguing about a line that was built for a different kind of shopper.
If you want a starting number for the AI visibility row, the free check at aeowhisperer.com takes a couple of minutes.