How each one filters reviews
| Yelp | Angi | ||
|---|---|---|---|
| How reviews are screened | Recommendation software scores each review on "hundreds of signals", including the reviewer's activity on Yelp | "As soon as someone posts a review, we send it to our moderation system"; machine learning first, then human operators on flagged content | Reviews "cannot be submitted anonymously"; processes to stop pros reviewing themselves or competitors; filters for fraudulent reviews |
| What counts toward the star rating | Recommended reviews only; not-recommended reviews sit on a secondary page and "do not factor into a business's overall star rating" | Not stated on the pages cited | Ratings "weighted across all reviews submitted" for the pro |
| Published enforcement figures | 76% recommended, 15% not recommended, 9% removed of all reviews submitted (10-K FY2025). For 2025 alone: 70% recommended, 17% not, 11% removed of about 22 million (Trust & Safety report) | 240M+ policy-violating reviews blocked or removed, 12M+ fake Business Profiles removed or blocked, in 2024 | No removal count in the 10-K |
| License badge | "Verified License", a "paid upgrade for certain eligible licensed businesses" | In Local Services Ads only: Google "validates these licenses against the state or country databases" | Businesses attest to licensing |
| Who pays the platform | Advertisers: 95% of 2025 revenue | Advertisers (Local Services Ads); reviews and profiles are free | Contractors, per consumer match, plus ads and memberships |
Sources: Yelp 10-K FY2025 and 2025 Trust & Safety report; Google's Maps content policy, Maps blog posts (Feb 2022, Apr 2025) and Local Services help; Angi 10-K FY2024.
Yelp: a filter you can see
Yelp's recommendation software sorts every review. The 10-K says reviews may be not recommended when they are written by "less active users, whom we don't know enough about to recommend", when they look suspicious (many reviews from one IP address), or when they are "less useful". So a genuine review from a first-time Yelp user can end up on the secondary page.
That is the root of a long-running complaint: businesses have alleged Yelp hides good reviews from firms that do not advertise. In Levitt v. Yelp the Ninth Circuit affirmed dismissal of those claims in 2014 (EFF case page). Yelp's 10-K says the software "applies the same objective standards to each review, regardless of whether the business being reviewed advertises on Yelp."
Yelp's 2025 Trust & Safety report says it rejected more than 50,700 potential new US and Canadian business pages for spammy behaviour, up 29%, which it put down to tighter moderation in high-risk categories including plumbing, garage door repair and locksmiths; it also removed more than 1,340 pages linked to "deceitful lead generators".
What you can do with this: on any Yelp contractor page, scroll to the bottom and open "reviews that are not currently recommended". A long list of five-star first posts there is a pattern the headline rating hides.
Google: a filter you cannot see
Google checks each review when it is posted and keeps checking afterwards, looking at the review text, the account's history and "uncharacteristic activity" at the place (Google blog, Feb 2022). Its content policy bans reviews "paid for, directly or in kind", incentives such as discounts in exchange for any review, reviews based on a conflict of interest including "current or former employment", and businesses that "selectively solicit positive reviews from customers".
Google's pages describe no equivalent of Yelp's not-recommended page, so you cannot see what its filter took out. Google's license check also belongs to its paid ads: the Local Services screening page describes owner background checks and license validation for advertisers, not for every business with a map listing.
The FTC rule both sit under
The FTC's Trade Regulation Rule on the Use of Consumer Reviews and Testimonials (16 CFR Part 465) took effect on 21 October 2024 (Federal Register). It bans fake or false reviews and testimonials, buying positive or negative reviews, undisclosed insider reviews, company-controlled "independent" review sites, review suppression, and fake social-media indicators, and lets the FTC seek civil penalties against knowing violators (FTC, Aug 2024). One gap: the FTC's own Q&A says the rule "does not contain a specific prohibition" on asking only happy customers for reviews, though the practice "could violate the FTC Act". Google's policy bans it outright.
What a 4.8 means, and what it doesn't
A 4.8 is the average of the reviews that survived that site's filter, written by customers who chose to write one. On Thumbtack, 4.8 is the minimum rating for the Top Pro badge (Thumbtack Pro Center, c. 2018).
It does not tell you whether the roof passed final inspection, whether the permit was pulled at all, or whether the license is active today. Those three are in public records, and none of the three review sites shows them.
What the permit file adds
Here is the roofing record in three cities, the same trade on each review site above.
| San Francisco | Minneapolis | Anaheim | |
|---|---|---|---|
| Roofing permits | 9,537 | 18,620 | 1,970 |
| Firms | 1,072 | 1,483 | 568 |
| Share of permits finished | 87.3% | 93.0% | 96.4% |
| Finished share at the 10th-percentile firm (10+ permits) | 62.2% | 75.6% | 89.1% |
| Firms with 10+ permits finishing under 70% | 20 of 135 | 19 of 351 | 0 of 35 |
| Firms whose license is now expired, suspended or similar | 30 | 171 | 15 |
The useful rows are the spread and the license count. In San Francisco, 20 roofers with ten or more permits finished fewer than 70% of them. In Minneapolis, 171 firms that pulled roofing permits now match a Minnesota license that is not active. The file cannot say which of them closed and which are still taking jobs.
The limits, once: a permit that is not finished is not proof of bad work (the owner may have stopped the job, or the inspection may be booked), the file shows only permitted work, and we join licenses by business name, so a firm can go unmatched. Minneapolis has the most unmatched roofing firms of the three, 12.5%.
A five-minute check on a well-reviewed roofer
- On Yelp, open the not-recommended reviews at the bottom of the page and read the oldest and newest.
- Look up the license on the state board: CSLB Check a License in California, Minnesota DLI lookup in Minnesota. Status must be active today.
- Find the firm on our roofing compare page for your city. Compare its finished share with the city row in the table above, and count how many of its permits are still open.
How we know this
Review-filter figures are from Yelp's 10-K for 2025 and its 2025 Trust & Safety report, Google's Maps content policy, two Google Maps blog posts and Google's Local Services screening page, and Angi's 10-K for 2024, all read on 20 October 2026. The FTC rule's effective date is from the Federal Register notice. Our roofing counts are from San Francisco's, Minneapolis's and Anaheim's public permit files for the window shown, joined by business name to CSLB and Minnesota DLI license records; name matching can miss, so unmatched firms are never labelled unlicensed. "Finished" means the city recorded a final inspection or completion.
Numbers come from San Francisco DBI building permits on one- and two-family homes, with the contractor from the city's permit contacts file; City of Minneapolis construction permits (CCS); City of Anaheim Accela building permits on single-family homes and ADUs, data through October 17, 2026. Nobody paid to be on this page and nobody can.
See every San Francisco roofer by their permit record →
Questions
- Are Google reviews or Yelp reviews more reliable for contractors?
They filter differently. Yelp's software recommended about 76% of all reviews submitted and Yelp removed about 9% (Yelp 10-K FY2025); only recommended reviews count toward the star rating. Google screens each review when it is posted and says it blocked or removed more than 240 million policy-violating reviews in 2024. Neither publishes a filter rate for contractors specifically.
- Does Yelp hide reviews from businesses that don't advertise?
Businesses have alleged it. In Levitt v. Yelp the Ninth Circuit affirmed dismissal of their claims (2014), and Yelp's 10-K says its software applies the same standards whether or not a business advertises.
- Is it legal for a contractor to pay for reviews?
Not under the FTC's rule on consumer reviews (16 CFR Part 465, effective 21 October 2024), which bans buying positive or negative reviews, fake reviews and review suppression, among other things. Google's policy also bans paid or incentivised reviews.
- Yelp vs Angi for contractors, which is better for a homeowner?
Yelp is a review site paid for by advertising (95% of 2025 revenue, Yelp 10-K). Angi is a lead marketplace where contractors pay per consumer match; its reviews cannot be anonymous and pros averaging under 3 stars lose approved status (Angi 10-K FY2024). Neither shows permits or inspections.
- What does a 4.8-star contractor rating tell me?
That the reviews which survived the site's filter average 4.8. It does not tell you whether the jobs passed final inspection or whether the license is active today. Check those on the city permit file and the state board.
Build your own list
Every firm with that kind of permit on record. Pick what you value. The list moves.
Related guides
- Angi vs HomeAdvisor: same company, how each works and what it costs, and what neither shows you
- BuildZoom vs Contractor Records: how BuildZoom works and what it costs
- Is Angi (formerly Angie's List) worth it? How it works and what it costs homeowners
- How to check a contractor's license in California
For one city
- Yelp Inc. Form 10-K FY2025 (2026-02)
- Yelp Releases 2025 Trust & Safety Report (Business Wire) (2026-02-25)
- Levitt v. Yelp (EFF case page) (2014-09-02)
- Prohibited & restricted content (Google Maps user contributed content policy) (2026-10-20)
- How reviews on Google Maps work (Google blog) (2022-02-02)
- Google Maps uses AI to fight fake Business Profiles (Google blog) (2025-04-07)
- Understand the screening and verification process (Google Local Services Help) (2026-10-20)
- Angi Inc. Form 10-K FY2024 (2025-02)
- Trade Regulation Rule on the Use of Consumer Reviews and Testimonials, 16 CFR Part 465 (Federal Register) (2024-08-22)
- Federal Trade Commission Announces Final Rule Banning Fake Reviews and Testimonials (2024-08-14)
- The Consumer Reviews and Testimonials Rule: Questions and Answers (FTC) (2026-10-20)
- Thumbtack Pro Center: Top Pro (2018)
- CSLB Check a License (2026-10-20)
- License and registration lookup (Minnesota DLI) (2026-10-20)