Bot Benchmark study - White Ops & DCN

27

Transcript of Bot Benchmark study - White Ops & DCN

Page 1: Bot Benchmark study - White Ops & DCN
Page 2: Bot Benchmark study - White Ops & DCN

Advancing the Future of Trusted Content

Page 3: Bot Benchmark study - White Ops & DCN

Digital Content Next

Digital Content Next is the only trade association that exclusively serves the unique and diverse

needs of high-quality digital content companies that manage trusted, direct relationships with

consumers and marketers.

Page 4: Bot Benchmark study - White Ops & DCN

• Opportunity for DCN to take a proactive leadership position while the rest of the industry is swirling

• Initiated study with White Ops after Board approval at April 2015 meeting

• 32 participating member companies • Michael Tiffany, CEO of White Ops, is here to present a first

look at the results• Goal of this meeting is to answer questions and make sure

members have this intelligence in their knowledge base

DCN Bot Benchmark Study

Page 5: Bot Benchmark study - White Ops & DCN

Display Video0%

5%

10%

15%

20%

25%

2.8% 2.5%

11%

23%

89% less bot traffic in video; 75% less in stan-dard display impressions on premium publisher

sites

DCN 2015 ANA 2014

Top-Line Results

Page 6: Bot Benchmark study - White Ops & DCN

DCN Perspective

"We always knew DCN members had the most trusted content by consumers but now there is additional proof they should also be the most trusted experiences for advertisers. Period."

Page 7: Bot Benchmark study - White Ops & DCN

DCN Perspective

“Quality content is the best filter for reaching engaged, human audiences. Based on this study we know that approximately 97% of the digital ad fraud happens elsewhere on the web.”

Page 8: Bot Benchmark study - White Ops & DCN

DCN Perspective

“It’s incredibly important that all premium publishers know the work doesn't stop here. The policies and brand trust of premium publishers are something which are earned and added to each and every day. While we are in a rapidly evolving environment, this confidence and trust in the context and quality of our brands is one of our most sustainable assets. We will and must continue to lead the industry from here forward.”

Page 9: Bot Benchmark study - White Ops & DCN

Thank you to DCN Ad Fraud Committee

• Dan Stubbs, Conde Nast – Co-chair• Andy Wilson, Meredith – Co-chair

• Ryan Whittington, American City Business Journals• Stephen Felisan, Edmunds.com• David Payne, Gannett• Mike Kisseberth, Purch• Tammy Franklin, Scripps Networks • Jim Spanfeller, Spanfeller Media Group

Page 10: Bot Benchmark study - White Ops & DCN

Confidential. Copyright 2015 White Ops, Inc.Confidential. Copyright 2015 White Ops, Inc.

10

Page 11: Bot Benchmark study - White Ops & DCN

Confidential. Copyright 2015 White Ops, Inc.

11

Study Background and Context

Executive Summary

Detailed Findings and Supporting Data

Conclusion and recommendations

Page 12: Bot Benchmark study - White Ops & DCN

Confidential. Copyright 2015 White Ops, Inc.Confidential. Copyright 2015 White Ops, Inc.

0 5 10 15 20 25 30 350.00%

1.00%

2.00%

3.00%

4.00%

5.00%

6.00%

7.00%

8.00%

Advanced Bot Percent

DCN benchmark study overview

12

DCN Global Results32 participating organizations30 billion impressions2.8% advanced bots

Range: 1.6% to 6.9%2.7% IAB Bots

Range: .7% to 11.4%Average (All Bots): 5.5%

Range: .7% to 11.4%

Page 13: Bot Benchmark study - White Ops & DCN

Confidential. Copyright 2015 White Ops, Inc.Confidential. Copyright 2015 White Ops, Inc.

Implementation details

Testing & QA: 6/22 - 7/1, 2015Data collection: 7/1 - 8/14, 2015

• Compares individual and global DCN results with ANA 2014 study. Analysis is based on deterministic detection of bot traffic

• To match ANA 2014 The Bot Baseline, we calculate results using measurable desktop (non-mobile) inventory. For total bot percentage calculations, we remove IAB registered bots and spiders.

• No data or results were provided to participants or the DCN during the study

13

• White Ops Detection Tags were deployed by study participants via their ad server, directly into the pages of their website, or a combination of both

• Media types were specified by participants. Where possible, White Ops deduced media type programmatically at a per-impression level

• For unmeasurable desktop inventory (<10% of total impressions for DCN participants), we assume that the bot percentage is similar to measurable inventory bot percentages.

Some publishers choose to sell inventory across web properties that they do not own and operate, commonly referred to as partner networks, syndication networks or audience extension networks. Such inventory falls outside the scope of the results in this study.

Page 14: Bot Benchmark study - White Ops & DCN

Confidential. Copyright 2015 White Ops, Inc.Confidential. Copyright 2015 White Ops, Inc.

Definitions

• Decision – deterministic identification of a particular impression, page view, or other type of online event as bot or not

• Advanced bot - an invalid impression positively identified as a bot using deterministic methods

• IAB registered bot – percentage of bots that are on the IAB list

• Href domain – the domain where a particular ad impression, page view, video play, or other online event occurred

• True domain – verified URL/domain which was loaded

• Referring domain – domains that send traffic to the site

• Incomplete load / non-measurable – cases where the JavaScript tag was not loaded due to factors such as browser abandonment or site configuration

• False-positives – detection results that indicate bot or ad fraud impressions when the impressions are actually legitimate

14

Page 15: Bot Benchmark study - White Ops & DCN

Confidential. Copyright 2015 White Ops, Inc.

15

Study Background and Context

Executive Summary

Detailed Findings and Supporting Data

Conclusion and recommendations

Page 16: Bot Benchmark study - White Ops & DCN

Confidential. Copyright 2015 White Ops, Inc.

16

The DCN average bot percentage for display inventory was one quarter of the level of ANA 2014 display baseline study data, and DCN average bot percentage for video inventory was one tenth of the bot rate seen in ANA 2014 baseline study inventory.

Selectively buying direct-placement digital ad inventory from this group of premium publishers, if quality is maintained consistently across inventory, could allow marketers to achieve the humanity levels of the top 19% of the ANA 2014 Bot Baseline marketers without instituting any other policy changes or buying decisions.

Benchmark Bot % by Media Type

Page 17: Bot Benchmark study - White Ops & DCN

Confidential. Copyright 2015 White Ops, Inc.

Some premium inventory sees bot hotspots

While the middle-of-the-road publisher in the DCN had a 2.8 percent sophisticated bot rate, a single publisher in the group encountered a 6.9 percent sophisticated bot rate, more than twice the average for the group. Another five publishers had sophisticated bot rates exceeding 4 percent.

17

Page 18: Bot Benchmark study - White Ops & DCN

Confidential. Copyright 2015 White Ops, Inc.

18

Study Background and Context

Executive Summary

Detailed Findings and Supporting Data

Conclusion and recommendations

Page 19: Bot Benchmark study - White Ops & DCN

Confidential. Copyright 2015 White Ops, Inc.

Sophisticated bots mimic viewability

Bots are spoofing viewability in nearly three-quarters of cases. Bots that come from a host dedicated to fraud, with no real human traffic -- referred to as isolation bots -- have high viewable rates and most frequently post back detailed viewability data.

19

Page 20: Bot Benchmark study - White Ops & DCN

Confidential. Copyright 2015 White Ops, Inc.

How publishers source traffic affects bot %

• Large content recommenders -- such as Jungroup, Outbrain and Taboola -- refer very little sophisticated bot traffic.

20

• Traffic from reputable search engines, such as Google and Yahoo, does have large sophisticated bot rates when coming from certain top-level domains.

• Smaller search engines show medium- to high-levels of bot traffic.

• Traffic from social-media sites tended to have lower bot rates.

Page 21: Bot Benchmark study - White Ops & DCN

Confidential. Copyright 2015 White Ops, Inc.

Ad injection affects publishers

CASE STUDY: A participant’s ad injection rate was higher than their sophisticated bot rate. Ad injection to one participant was greater than 3%, while sophisticated bot traffic was less than 2%. Similar levels of injection likely affect similar publishers.

21

Page 22: Bot Benchmark study - White Ops & DCN

Confidential. Copyright 2015 White Ops, Inc.

False-positives affect publishers

39 percent of publishers surveyed said they had been presented with reports of Invalid Traffic (IVT) in their data. A sample of DCN publishers and their potential monthly losses from 7% FPs in vendor reporting This graph uses the vendor’s White Ops-detected sophisticated bot % with the vendor’s self-reported CPM, volume averaged over the group.

22

Page 23: Bot Benchmark study - White Ops & DCN

Confidential. Copyright 2015 White Ops, Inc.

Strategies improve inventory quality

Case study: A top-volume publisher who did not source traffic and only sold inventory via direct buys had a very low bot average.

23

"287551497" "274604937" "320642577" "331366377" "325221897" "353379417" "323758377" "338015457" "342205017" "354899817" "306473697" "0"0

50000

100000

150000

200000

250000

300000

350000

0

5

10

15

20

25

30

35

All campaign bot percentages throughstudy period

Decisions (Thousands) Advanced Bot Percent

Page 24: Bot Benchmark study - White Ops & DCN

Confidential. Copyright 2015 White Ops, Inc.

24

Study Background and Context

Executive Summary

Detailed Findings and Supporting Data

Conclusion and recommendations

Page 25: Bot Benchmark study - White Ops & DCN

Confidential. Copyright 2015 White Ops, Inc.

25

Confidential. Copyright 2015 White Ops, Inc.

Conclusions

While high-quality publishers have a lesser sophisticated bot problem than the advertising ecosystem in general, publishers can maintain high humanity levels through policies and strategies.

Sophisticated bots will continue to better emulate humans. Increasingly, parasitical bots target cookies or implant themselves in legitimate browsers, allowing the automated traffic to don the cloak of legitimacy and appear to be an actual human visiting sites.

Data-informed strategies can help publishers avoid third parties who provide traffic with high sophisticated bot rates.

Direct buys to premium publishers who demonstrate the commitment to maintain low sophisticated bot rates can consistently yield human audience levels of 97% or more.

Publishers can protect their marketers by agreeing to transparency in inventory quality, allowing tracking of inventory quality for validating traffic bot and humanity percentages, and by agreeing to bill based on humanity.

Page 26: Bot Benchmark study - White Ops & DCN

Confidential. Copyright 2015 White Ops, Inc.

If sourcing traffic, monitor sourced traffic to protect marketers from increased risk

Select suppliers with proven high humanity levels and a commitment to quality

Insist on vendor transparency for detection methodology to improve validation

For inventory with irregular humanity percentages or high CPMs, monitor for bot

activity to limit bot spikes

Improve page measurability to precisely manage inventory quality

Monitor for ad injection and other attacks that could damage your brand

Use bots’ evasive techniques to identify and expose them

26

Recommendations

Publishers can win more RFPs, secure larger shares of advertiser budget and justify higher CPMs by selling on your biggest market advantage: a premium human audience.

Page 27: Bot Benchmark study - White Ops & DCN

Confidential. Copyright 2015 White Ops, Inc.

Thank You!www.whiteops.com