{"_id":"59b8464d2c15d900243c8019","project":"5615790c0f5ed00d00483dd1","version":{"_id":"5615790d0f5ed00d00483dd4","__v":6,"project":"5615790c0f5ed00d00483dd1","createdAt":"2015-10-07T19:57:01.307Z","releaseDate":"2015-10-07T19:57:01.307Z","categories":["5615790d0f5ed00d00483dd5","56157b2af432910d0000f9fe","56157cfb0f5ed00d00483ddb","562684d95db46b1700fd4f48","573b7ea9ef164e2900a2b8ff","582e285d8373c20f00810608"],"is_deprecated":false,"is_hidden":false,"is_beta":false,"is_stable":true,"codename":"","version_clean":"1.0.0","version":"1.0"},"category":{"_id":"5615790d0f5ed00d00483dd5","__v":19,"pages":["5615790e0f5ed00d00483dd7","561d48e46386060d00e06003","561d48fe31d9630d001eb5bd","561d49b657165b0d00aa5d8b","561d4a879463520d00cd11e2","561d67f48ca8b90d00210234","561d6a0bf0cff80d00ca22c3","561d6c5b071cd60d000d3221","562f9c2543c5570d001fe6bd","56311c99eae7ef0d00270e3d","56311d6702aff217007dba23","56311f96f1c0580d00fac719","563120b7242cda1900198b79","5631229bf1c0580d00fac721","563131559ead230d00a188f6","563134a324014b0d00bd9a4f","5631392082d96a0d00b0fb1d","56313c584b36120d00fdebfb","5642658ef424a10d00118360"],"project":"5615790c0f5ed00d00483dd1","version":"5615790d0f5ed00d00483dd4","sync":{"url":"","isSync":false},"reference":false,"createdAt":"2015-10-07T19:57:01.871Z","from_sync":false,"order":0,"slug":"opendns-investigate-rest-api","title":"Umbrella Investigate REST API"},"user":"560b40145148ba0d009bd0b5","__v":0,"parentDoc":null,"updates":[],"next":{"pages":[],"description":""},"createdAt":"2017-09-12T20:40:45.133Z","link_external":false,"link_url":"","githubsync":"","sync_unique":"","hidden":false,"api":{"results":{"codes":[]},"settings":"","auth":"required","params":[],"url":""},"isReference":false,"order":19,"body":"The /topmillion endpoint returns the Umbrella top popular domains seen list.  The data can be downloaded in a zip file directly (see below), but the Investigate API can be used to stream this data into a SIEM more easily than downloading a file.\n\nThe popularity list contains our most queried domains based on passive DNS usage across our Umbrella global network of more than 100 Billion requests per day with 65 million unique active users, in more than 165 countries. Unlike Alexa, the metric is not based on only browser based 'http' requests from users but rather takes in to account the number of unique client IPs invoking this domain relative to the sum of all requests to all domains. In other words, our popularity ranking reflects the domain’s relative internet activity agnostic to the invocation protocols and applications where as ’site ranking’ models (such as Alexa) focus on the web activity over port 80 mainly from browsers.\nAs for Alexa, the site’s rank is based on combined measure of unique visitors (Alexa users who visit the site per day) and page views (total URL requests from Alexa users for a site). Umbrella popularity lists are generated on a daily basis reflecting the actual world-wide usage of domains by Umbrella global network users and includes root domains, subdomains in addition to TLDs (Alexa list has only this). In addition, Umbrella popularity algorithm also applies data normalization methodologies to smoothen potential biases that may occur in the data due to sampling of the DNS usage data.\n\n\n\nFor more, read here:\nhttps://umbrella.cisco.com/blog/2016/12/14/cisco-umbrella-1-million/\n\nsample query\n[block:code]\n{\n  \"codes\": [\n    {\n      \"code\": \"curl -H \\\"Authorization: Bearer %YourToken%\\\" \\\"https://investigate.api.umbrella.com/topmillion?limit=1000\\\"\",\n      \"language\": \"text\"\n    }\n  ]\n}\n[/block]\n\n**NOTE:** Without the limit, you will return all 1 million results.  If this is done in a browser, the volume of memory being used can cause the browser to crash.  We recommend only using this endpoint once a day at the maximum as the data does not change much within a day.  The limit is the only parameter.\n\n### Returned value for output if Success 200 ###\n[block:parameters]\n{\n  \"data\": {\n    \"h-0\": \"Field\",\n    \"h-1\": \"Type\",\n    \"h-2\": \"Description\",\n    \"0-0\": \"list of domains (no label)\",\n    \"0-1\": \"ordered array\",\n    \"0-2\": \"the list of most popular domains, starting from the most popular and descending.\"\n  },\n  \"cols\": 3,\n  \"rows\": 1\n}\n[/block]\n\n[block:html]\n{\n  \"html\": \"<div class=\\\"api-code-block\\\">\\n  <div class=\\\"api-code-block__header\\\">\\n    <span class=\\\"api-code-block__header__label\\\">GET</span> https://investigate.api.umbrella.com//topmillion?limit=10\\n  </div>\\n  <div class=\\\"api-code-block__section\\\">\\n    <div class=\\\"api-code-block__section__header\\\">REQUEST</div>\\n    <pre>curl --include \\\\\\n     --header \\\"Authorization: Bearer %YourToken%\\\" \\\\\\nhttps://investigate.api.umbrella.com//topmillion?limit=1000\\n    </pre>\\n  </div>\\n  <div class=\\\"api-code-block__section\\\">\\n    <div class=\\\"api-code-block__section__header\\\">RESPONSE <em>(HTTP 200, Content-Type: application/json)</em>\\n    </div>\\n    <pre>\\n[\\n\\\"google.com\\\",\\n\\\"netflix.com\\\",\\n\\\"api-global.netflix.com\\\",\\n\\\"microsoft.com\\\",\\n\\\"www.google.com\\\",\\n\\\"facebook.com\\\",\\n\\\"doubleclick.net\\\",\\n\\\"g.doubleclick.net\\\",\\n\\\"googleads.g.doubleclick.net\\\",\\n\\\"hola.org\\\"\\n]\\n    </pre>\\n  </div>\\n</div>\"\n}\n[/block]","excerpt":"","slug":"top-million-domains","type":"basic","title":"Umbrella Popularity List (Top Million Domains)"}

Umbrella Popularity List (Top Million Domains)


The /topmillion endpoint returns the Umbrella top popular domains seen list. The data can be downloaded in a zip file directly (see below), but the Investigate API can be used to stream this data into a SIEM more easily than downloading a file. The popularity list contains our most queried domains based on passive DNS usage across our Umbrella global network of more than 100 Billion requests per day with 65 million unique active users, in more than 165 countries. Unlike Alexa, the metric is not based on only browser based 'http' requests from users but rather takes in to account the number of unique client IPs invoking this domain relative to the sum of all requests to all domains. In other words, our popularity ranking reflects the domain’s relative internet activity agnostic to the invocation protocols and applications where as ’site ranking’ models (such as Alexa) focus on the web activity over port 80 mainly from browsers. As for Alexa, the site’s rank is based on combined measure of unique visitors (Alexa users who visit the site per day) and page views (total URL requests from Alexa users for a site). Umbrella popularity lists are generated on a daily basis reflecting the actual world-wide usage of domains by Umbrella global network users and includes root domains, subdomains in addition to TLDs (Alexa list has only this). In addition, Umbrella popularity algorithm also applies data normalization methodologies to smoothen potential biases that may occur in the data due to sampling of the DNS usage data. For more, read here: https://umbrella.cisco.com/blog/2016/12/14/cisco-umbrella-1-million/ sample query [block:code] { "codes": [ { "code": "curl -H \"Authorization: Bearer %YourToken%\" \"https://investigate.api.umbrella.com/topmillion?limit=1000\"", "language": "text" } ] } [/block] **NOTE:** Without the limit, you will return all 1 million results. If this is done in a browser, the volume of memory being used can cause the browser to crash. We recommend only using this endpoint once a day at the maximum as the data does not change much within a day. The limit is the only parameter. ### Returned value for output if Success 200 ### [block:parameters] { "data": { "h-0": "Field", "h-1": "Type", "h-2": "Description", "0-0": "list of domains (no label)", "0-1": "ordered array", "0-2": "the list of most popular domains, starting from the most popular and descending." }, "cols": 3, "rows": 1 } [/block] [block:html] { "html": "<div class=\"api-code-block\">\n <div class=\"api-code-block__header\">\n <span class=\"api-code-block__header__label\">GET</span> https://investigate.api.umbrella.com//topmillion?limit=10\n </div>\n <div class=\"api-code-block__section\">\n <div class=\"api-code-block__section__header\">REQUEST</div>\n <pre>curl --include \\\n --header \"Authorization: Bearer %YourToken%\" \\\nhttps://investigate.api.umbrella.com//topmillion?limit=1000\n </pre>\n </div>\n <div class=\"api-code-block__section\">\n <div class=\"api-code-block__section__header\">RESPONSE <em>(HTTP 200, Content-Type: application/json)</em>\n </div>\n <pre>\n[\n\"google.com\",\n\"netflix.com\",\n\"api-global.netflix.com\",\n\"microsoft.com\",\n\"www.google.com\",\n\"facebook.com\",\n\"doubleclick.net\",\n\"g.doubleclick.net\",\n\"googleads.g.doubleclick.net\",\n\"hola.org\"\n]\n </pre>\n </div>\n</div>" } [/block]