![\"\"](\"https:\/\/james-batchelor.com\/wp-content\/uploads\/2025\/09\/image.png\")
<\/a><\/figure>\n\n\n\n\n\n\n\nHistory<\/h2>\n\n\n\n
Since getting online in the late 90\u2019s, I had always found the concept of networks and being able to access servers and web content from anywhere in the world absolutely fascinating.<\/p>\n\n\n\n
I dabbled in html in the early years, creating my stake on the internet using Yahoo GeoCities. So, when given the opportunity to build a website for my friend\u2019s music band, I wanted to create something bespoke; something that included social interaction, but being fully integrated to the website and importantly, without adverts.<\/p>\n\n\n\n
Back then, to do this for free would involve creating a guestbook on a 3rd<\/sup> party site such as Lycos, among the other web tools that were rife at the time. Hosting dynamic content was relatively involved and not inexpensive, so providers such as Lycos would offer to do this for you, and support it with adverts. I\u2019ve touched on this a while back following the end of Lycos. LINK<\/p>\n\n\n\n My solution, host the web server myself! The rational was that using my own server I could serve dynamic content and fully integrate it into the website. The catalyst was recently getting an \u201calways on\u201d internet connection in the form of cable internet in 2001, and that my first PC was made obsolete by the introduction of my second PC.<\/p>\n\n\n\n In 2002, using my first PC, Windows NT 4.0 Server, a dynamic DNS service, and purchasing a Netgear RT311 router, I started self-hosting.<\/p>\n\n\n The thrill of self-hosting came from the IIS logs, constantly reviewing them to see connections from around the world requesting files from the box in the corner of my room.<\/p>\n\n\n\n Analog, the web log parser came along as an evolution to this, allow consolidation of the logs into a single web page for easy reference and wonder. The more the logs grew, the more the statistics grew and the trends started to develop and reinforce themselves.<\/p>\n\n\n\n Analog has been around since 1995 and is largely unchanged, but still receives periodic maintenance updates from the C:Amie Edition<\/a>.<\/p>\n\n\n\n Starting with the 10 year view, these are my points of interest for the modern internet, from this website\u2019s perspective\u2026<\/p>\n\n\n\n Page requests and visits really took off in 2020, seeing over a five-fold increase in traffic from June 2020. Its unsure if it was a popular post, or the Google algorithm looked favourably on my site, but people sure had a lot of spare time around this period.<\/p>\n\n\n\n I\u2019ve recently moved away from hosting directly from home (more in a future post) and since moving presence to a commercial VPS service I\u2019ve seen an uptick in visits. This should be good news, but a deeper look at the logs and the increased traffic is from malicious bots, targeting the common WordPress vulnerabilities. These bots must target IP ranges of established hosting providers.<\/p>\n\n\n\n Back when I started viewing Analog reports, the domain report was my way of gauging where in the world a visitor is from. Since then, the boundaries of domains have blurred drastically, and more used for vanity rather that identification. For example, have I really had 13722 visits from .vn (Vietnam)?<\/p>\n\n\n\n While hosting from home, I used Cloudflare as a proxy for a thin veil of security against exposing my IP. This had a detriment to the logs in the form of caching, where Cloudflare would serve a page rather than my server, and so not getting the log of the transaction. This caching also did register as a noticeable drop in traffic.<\/p>\n\n\n\n Back in 2004, I only need worry about web crawlers scraping and indexing the site. Today, anyone can use a cheap VPS or commercial VPN service to anonymously attack and brute force a site it has become an epidemic. Now, my highest failure reports come from other hosting services.<\/p>\n\n\n\n Finally, did someone really try to visit this site on a RISC OS system or even an Amiga?<\/p>\n\n\n\n Turning the clock back 20 years to my hosting infancy, I found an old report buried in a website backup, again, parsed by Analog.<\/p>\n\n\n\n Granted, this is a snapshot of from a much-reduced sample period, but in honesty, believe the real human visitor count is on par to what this website is now. Albeit catering to very localised content.<\/p>\n\n\n\n This may be highly skewed by the localised content of the site at the time, but what struck me was the predictability of when users were visiting the site. With a sharp drop during the early hours and peaking in the evening. An indication that these were real visitors.<\/p>\n\n\n\n A benefit of creating the website yourself. With the exception of forums, off the shelf applications such as WordPress were yet to materialise. Therefore, the file request reports were easier to decipher and to identify popular sections.<\/p>\n\n\n\n Self-hosting relied on using your home connection to serve pages to the world, and given that most home internet connections are asynchronous, you had to make the website as efficient as possible.<\/p>\n\n\n\n During this snapshot, while I had a modest 600kbps downstream bandwidth, the upstream utilised by visitors was just 128kbps.<\/p>\n\n\n\n More nostalgia than a trend, but this complete list of OS visitors takes you back.<\/p>\n\n\n\n While a delightful look back, both at the web logs and the website files the discovery was bundled with. It makes you want to go back to those simpler times.<\/p>\n\n\n\n <\/p>\n","protected":false},"excerpt":{"rendered":" This week I noticed a little milestone; my current iteration of website logs had clicked over to 10 years\u2019 worth of accumulated statistics. While I\u2019ve been self-hosting websites since 2002, it wasn\u2019t until 2015 that I started making a conscious effort to backup and retain web logs during server reinstalls and migrations. To create statistics … Continue reading “10 years of website logs, and the resulting nostalgia trip”<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[5,6],"tags":[416,38,417],"class_list":["post-1051","post","type-post","status-publish","format-standard","hentry","category-servers","category-websites","tag-analog","tag-home-server","tag-weblog"],"_links":{"self":[{"href":"https:\/\/james-batchelor.com\/index.php\/wp-json\/wp\/v2\/posts\/1051","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/james-batchelor.com\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/james-batchelor.com\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/james-batchelor.com\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/james-batchelor.com\/index.php\/wp-json\/wp\/v2\/comments?post=1051"}],"version-history":[{"count":2,"href":"https:\/\/james-batchelor.com\/index.php\/wp-json\/wp\/v2\/posts\/1051\/revisions"}],"predecessor-version":[{"id":1066,"href":"https:\/\/james-batchelor.com\/index.php\/wp-json\/wp\/v2\/posts\/1051\/revisions\/1066"}],"wp:attachment":[{"href":"https:\/\/james-batchelor.com\/index.php\/wp-json\/wp\/v2\/media?parent=1051"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/james-batchelor.com\/index.php\/wp-json\/wp\/v2\/categories?post=1051"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/james-batchelor.com\/index.php\/wp-json\/wp\/v2\/tags?post=1051"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}<\/a><\/figure><\/div>\n\n\nLogging<\/h3>\n\n\n\n
10 Year Trend<\/h2>\n\n\n\n
Traffic exploded during lockdown<\/h3>\n\n\n\n
<\/a><\/figure>\n\n\n\nSelf-hosting shielded bot access<\/h3>\n\n\n\n
<\/a><\/figure>\n\n\n\nDomains mean nothing anymore<\/h3>\n\n\n\n
<\/a><\/figure>\n\n\n\nCloudflare ruins logs<\/h3>\n\n\n\n
<\/a><\/figure>\n\n\n\nBots, bots everywhere<\/h3>\n\n\n\n
<\/a><\/figure>\n\n\n\nOperating Systems<\/h3>\n\n\n\n
<\/a><\/figure>\n\n\n\n20 Year Snapshot<\/h2>\n\n\n\n
<\/a><\/figure>\n\n\n\nHourly trends were what you expect.<\/h3>\n\n\n\n
<\/a><\/figure>\n\n\n\nFile requests were easier to understand.<\/h3>\n\n\n\n
<\/a><\/figure>\n\n\n\nData transfer was at a premium.<\/h3>\n\n\n\n
<\/a><\/figure>\n\n\n\nOperating Systems<\/h3>\n\n\n\n
<\/a><\/figure>\n\n\n\nSummary<\/h2>\n\n\n\n