What a competitor's website tells you in 15 minutes

"What are our competitors doing?" usually gets answered one of two ways: by feel ("their Instagram is stronger than ours"), or by an expensive report. Yet most of the answer already sits on the competitor's own website, in files they deliberately left open.

The routine below takes about fifteen minutes and needs no paid tool. Nothing here is secret: every step is either data the competitor opened to search engines on purpose, or data the platforms publish themselves. This is reading, not spying.

First 5 minutes: they hand you the map

The robots.txt file

Type competitor.az/robots.txt into your address bar. This small text file exists on almost every site and is open to everyone; its job is to tell search crawlers which sections to visit. What matters to you is the Sitemap: line — Google's robots.txt specification states that it points to the full address of a sitemap, and that a file may carry several such lines.

While you are there, skim the Disallow: lines. Blocked paths often reveal the back kitchen: staging sections, old campaign pages, the name of the admin panel.

The sitemap — every page in one list

Open the address from the Sitemap: line. A sitemap lists the pages a site wants search engines to see, which makes it a public statement of priorities. Look for three things:

• How many service pages there are, and what they are called. Everything crammed onto one page, or a dedicated page per service? The second is a sign of real search work.
• The dates on blog posts. A post from this month means content is alive. A last post from two years ago means the channel was abandoned — and that is an open door for you.
• Pages missing from the menu. An address that appears in the sitemap but not in the navigation is usually the first trace of a service being prepared.
• The addresses themselves.

A volume check with the site: operator

Type site:competitor.az into Google. The number you get is an estimate, not a count — the exact figure is only visible to the site's own owner in the Search Console page indexing report. For orders of magnitude it is enough: the gap between 25 pages and 250 is a difference in strategy, not in budget.

Next 4 minutes: which words they are playing for

Stay on that same results page. Each blue headline was written by the competitor — it is the phrasing they want to be found by. Ask three questions:

1. Which word keeps repeating? "Website development" and "corporate digital solutions" call in completely different customers. The repeated phrase is the bet they placed.
2. Is there a city name? If the headlines say "Baku", they are playing for local search. If not, that ground is unclaimed.
3. How many languages? A /ru or /en

Now open their blog and read the headlines. Whatever questions they answer there are the questions their customers ask them — which makes the list a ready-made draft of your own content plan. It works in reverse too: a topic missing from the list is either unnecessary or simply unclaimed. The second happens more often than you would expect, because most of a market retells the same five stories.

Then read two pages end to end: the homepage and the most expensive service page. Watch four details — whether anything at all is said about price, what concrete outcome is promised, how many fields the form has, and whether a response time is stated. Those four show how ready their sales process is, and a handsome design very often hides an empty one.

3 minutes: the technical picture — usually the weakest link

Google's PageSpeed Insights runs on any public address, including your competitor's. Look at two things.

Real-user measurements. Per the documentation, this section shows data collected from Chrome users over the trailing 28 days, at the 75th percentile. That is not a lab estimate but what people actually experience — and the mobile column is usually noticeably worse than the desktop one.

Whether that section appears at all. If a page has too few samples, the tool falls back to origin level; if that is thin too, no real-user data is shown. This does not prove the site is bad, but it is the first place a "market leader" image gets tested — not having enough visitors to measure is itself an answer.

Last 3 minutes: where the ad money goes

Ad creative is public now, and searchable.

• Google Ads Transparency Center — search by advertiser name or domain, filter by region and date, and see the actual creative they are running.
• Meta Ad Library — in Meta's own words a searchable database of active ads; it shows what is running on Facebook and Instagram right now.

Know what these do not offer: no spend, no targeting, no results (political and social-issue ads are the exception). You learn the message, not the effectiveness. A creative that has been running for months is a strong hint, not proof — file it as a hypothesis to test, not as a finding.

Turning the notes into a decision

After fifteen minutes you have a page of notes. Split it into three columns:

• They have it, we do not — a gap worth closing, but only if the customer values it. Copying a competitor's mistake is just as easy as copying their good idea.
• We have it, they do not — a positioning advantage you already own. It belongs on your first screen, and in practice it almost never is.
• Nobody has it — the most valuable column. The unanswered question, the comparison nobody wrote, the price range nobody published. The cheapest visibility on any market starts here.

One warning: do not copy the price. A competitor's number rests on their cost base, their team and their contract terms, and none of that is visible on the website. Matching a visible price means guessing at an invisible economy.

The point of competitor analysis is not to copy the competitor, but to find the gap they never closed.

Making it a habit rather than a one-off

A single check gives you a snapshot; a repeated one gives you direction. Run the same fifteen minutes once a quarter and always write the result into the same table — the rate of change tells you far more than any single reading. Eight new pages in a month is bigger news than the fact that they have 200 in total.

If you want a number for the technical side, our free audit tool accepts a competitor's address as happily as your own: it reads Google's own measurement source and explains the result in plain language.

And if you need several competitors compared against the same criteria, the research work where we put a market into one table exists for exactly that — we gather the public sources, turn the differences into something measurable, and move the positioning call off gut feeling and onto data.