Hey developers,
I’ve been thinking about a problem and wanted to get some feedback from the community.
We have search engines like Google, Bing, and others that help us find websites through keywords.
We also have directories and archives, but I haven’t found a place that attempts to catalog every active website on the internet in a structured and discoverable way.
So my first question is:
Does a platform already exist where I can browse or search through a massive database of active websites, regardless of whether they’re popular or not?
The IdeaImagine a project called “Library of Websites.”Instead of ranking sites primarily through SEO and search algorithms, the goal would be to build a continuously growing database of active websites across the internet.
Website owners could install a small script or verification snippet on their sites, similar to how Google Search Console verification works.
Once verified, the website would automatically become part of the Library of Websites database.
The platform could then:Categorize websites by industry, niche, and technology.Track whether sites are still active.
Allow users to browse websites like books in a library.Discover small, independent websites that search engines rarely surface.
Create a searchable index of the web that focuses on discovery rather than ranking.
Over time, this could become a living map of the internet, helping people explore websites they would never normally find.
Does something like this already exist?
What are the biggest technical challenges in building such a database?
Would website owners actually be willing to install a verification script?
Is there a better approach than relying on voluntary website registration?
What would you personally want from a “Library of Websites” platform?
I’d love to hear your thoughts, criticism, and suggestions.Thanks!
Leave a Reply