Fun with Real-Time Data π
September 25, 2020
A curated collection of data-related awesomeness, with a focus on internet, communication & security
Work in progress- I'm continuing to update the list, whenever I come across something epic
My respect goes out to the legends behind each of these projects π
Awesome Real-Time Data Visualizations
- Internet
- Tor Flow - Real-time data flow between Tor nodes
- Internet Census - 24-hour world map of average utilization of IPv4 addresses
- ICMP ping requests sent out with Carna botnet. Learn more on the Official Site / see similar datasets
- Map of Mobile Internet - Shows world data coverage, according to Twitter data
- IKnow - Live data showing what content is being downloaded + distributed via torrents
- Semantic Internet Map - Shows how different websites link together
- Wiggle - Worlds largest WiFi Map showing personal hotspot statistics geographically
- BGP Stream - Shows all current outages
- DomainTools Statistics - Domain registration Numbers and Charts
- Freedom House - Censorship Map - Global internet freedom and democracy status per country, over time
- Insecam - A directory and feed of insecure or public live webcams
- Air & Sea
- Submarine Cable Map - An up-to-date map of major global internet cables (see also he.net and this)
- FlightRadar24 - World-wide map of live aircraft positions
- Marine Traffic - World-wide map of live ships, tankers, cargo & passenger vessels and more
- Stuff in Space - Shows objects orbiting Earth
- Asterank - A scientific and economic database of over 600,000 asteroids
- Flight Misery Map - Real-time US geographical flight delay & cancellation trends
- Meteor Showers - Shows commit locations, simulating meteor showers with time
- Airport WiFi Map - Shows WiFi networks and their passwords for airports around the world
- Misc
- One in a Million - A real-time Twitter map
- ListenToWikipedia - Wikipedia edits, represented by a tone, depending on size, built by Hatnote
- BitListen - Real-time BTC transactions, represented by bubbles and tones
- FiatLeak - Real-time crypto stats
- Google Search Terms - Hourly Google Search Trends, in your location
- Sentiment Sweep - Geographic sentiment analysis on real-time Twitter data (- I made this one)
- Three Thousand Years - Shows major events throughout history, using Wikipedia data
- Wiki-Atlas - Wikipedia articles, categorized and plotted on a map
- ncov2019/live - Real-time Covid-19 data, map and dashboard (by Avi Schiffmann)
- National Grid: Live Status - Real-time UK energy stats (by Kate Morley) (similar to Grid Watch)
- Globe of Economic Complexity - Visualize's 15 Trillion dollars of world trade, where each dot is $100,000,000 of export
- Cyber
- Checkpoint - Geographical plotting of Malware, Phishing and Exploits
- FortiGuard - Incoming & Outgoing Attacks per Country
- Kaspersky Stats - Shows detailed threats per second from a variety of categories
- Kaspersky LogBook - Historic Threat Time Line
- See also
- Every AV-provider and wannabe security company has a matrix-style cyber map nowadays, here are some less-spectacular ones, which didn't make it onto the list: Fire Eye, BitDefender, ESET, Looking Glass Cyber Map, Digital Attack Map
- pewpew is a sweet web component, that you can use to build your own threat map (with sound effects!)
Info Sec - Databases, APIs, References
Want to build your own live data visualization? The below data sources may be of help
- Exodus - Trackers in Android Apps
- Exploit Database - A database or Current software vulnerabilities
- URLScan - Service scanning for malicious domains, with historical results
- Dehashed - Data Breaches and Credentials
- VirusTotal - Detailed virus scans of software
- Abuse IP DB - Database of IPs reported for abuse
- SnusBase - Long standing database hosting breached data
- OpenPhish - A feed of current phishing endpoints
- HashToolkit - Database of 'cracked' hashes
- SecLists - Starter list of leaked databases, passwords, usernames etc (Great for programming)
- Qualys SSL Pulse - A continuous and global dashboard for monitoring the quality of SSL / TLS support over time across 150,000 SSL- and TLS-enabled websites, based on Alexaβs list of the most popular sites in the world
- Tor Bulk Exit List - List of all exit nodes (IP) in use on the Tor network
Info Sec - Research & Results
A collection of interesting studies that have collected, analysed and presented findings using internet data
- Internet Census Data - Includes data on address space allocation, traffic, DNS, service enumeration, internet outages and other internet topology data
- Web Tracking Data by Princeton University - This is the largest and most detailed analysis of online tracking to date, and measures both stateful (cookie-based) and stateless (fingerprinting-based) tracking. The crawls were made with OpenWPM
- Who has your Back? by EFF - Anual report assessing how companies handle personal data
- Lists of Websites Abusing Session Replay - Third-party sesssion replay scripts, record all your acions and allow them to be watched by a human. This list of websites include this
- Sensor Access Data - A Crawl of the Mobile Web Measuring Sensor Accesses, Illinois
- Canalys Newsroom - Research Studies on Security, Privacy, Technology and Finance
- Data Never Sleeps - An infographic visualizing how much data is generated every minute (2019)
- What they Know about You - An Infographic showing what information are Giant Tech Companies collecting from you (2020)
Finally- Here's a selection of pretty screenshots...
