The Dark Web is reflecting a little more light these days.
On Monday I wrote about Memex, DARPA’s Deep Web search engine. Memex is a sophisticated tool set that has been in the hands of a few select law enforcement agencies for a year now, but it isn’t available to regular users like you and me.
There is another search engine that is though.
Just a few days before I wrote that article, on 11 February, user Virgil Griffith went onto the Tor-talk mailing list and announced Onion City, a Dark Web search engine for the rest of us.
The search engine delves into the anonymous Tor network, finds .onion sites and makes them available to regular users on the ordinary World Wide Web.
Up to now the best way to search for .onion sites has been to get on the Tor network using something like the Tor browser, but Onion City effectively does that bit for you so you can search from the comfort of your favourite, insecure web browser.
The site can do this because it’s a Tor2web proxy – a bit of software that acts as a go-between for the regular web and the Tor network.
It acts as a Tor client inside the Tor network and presents the sites it finds as regular web pages using subdomains of .onion.city.
One of the consequences of working this way is that Onion City search results are just regular web pages like any other, which makes them visible to you, me, the Onion City search engine and also, for the first time, Google.
In fact, Onion City’s search functionality is a Google Custom Search, so if you can find something on Onion City you should be able to find it on Google too.
At the time of writing, there are about 650,000 Dark Web pages that have found their way into the regular Google index via Onion City.
Of course – as any small business owner can tell you – just because Google knows a website exists doesn’t mean the site’s pages will rank well. But those pages are at least in the mix now, enjoying their first rays of sunshine.
I took a quick look around and, because this is the Dark Web, I searched for amphetamines, 9mm ammunition and hackers for hire, and yes, it’s all in there.
If you’re tempted to do the same, I encourage you to read the rest of the article before you start.
Onion City isn’t doing anything wrong and it’s not ‘outing’ anyone on the Dark Web, it’s just providing a means for regular web users to search things they would otherwise have to work a little harder to find.
It reduces the barriers between people who want to find or consume something and people who want to provide it in a way that’s untraceable.
Any sites that don’t want to be indexed by Onion City can exclude themselves from the index in the same way that regular sites exclude themselves from regular search engines, using a humble robots.txt file (although that does mean they appear in a public list of sites that don’t want to be indexed).
Onion City users would be foolish to use it for anything illegal though because users get no protection whatsoever.
If you want to browse the Dark Web without leaving a trail, Onion City can’t help – you still need to be on the Tor network using a Tor browser.
This is a Tor2Web proxy so the Tor part where the .onion sites reside is as secure as Tor and the web part where you and I reside is as insecure as the web (it isn’t even available over HTTPS yet.)
What we users get is convenience, nothing more.
If you’re wondering why that would be useful, just think about sites like Wikileaks.
Wikileaks is a clearing house for materials provided by whistleblowers. Up to now it has had to choose between being vulnerable and public or safe and difficult to find (a situation that’s resulted in it taking out some bizarre protection.)
With Onion City, Wikileaks would have the option to retreat into the safety of the Tor network without sacrificing visibility.
Like all frontiers the Dark Web is lawless, exciting, disorganised and potentially dangerous. Frontiers don’t last though; people move in, the law moves in and basic utilities are established.
Thanks to Onion City, the cyber-frontier now has it’s first set of street lights.
Image of sliced onion courtesy of Shutterstock.
19 comments on “Onion.city – a search engine bringing the Dark Web into the light”
so.. your ISP knows you have been searching for amphetamines, 9mm ammunition and hackers for hire, Hmm…
Use a VPN to connect to Onion.City
Would doing this be as good or almost as good as using Tor directly?
No. The idea of Tor is that information about where and what you are browsing, including your searches, is (for the most part) invisible.
That’s why the article quite explicitly says:
TOR and onion city educates you against exploits. Read between the lines to separate facts from myths and lies. Every one and every organization no matter how powerful they are could also end up being vulnerable to exploits when you or they visit the internet, telecommunications, or electronic interaction. It is for you to arm yourself against those exploits. TOR or any other organization cannot protect you, only you can protect yourself.
This completely defeats the purpose of TOR.
I’m no expert on the dark web (I have used Tor but not for some years), my understanding of this article is that Tor still protects users in exactly the same way, if you want to do something on the dark web and be untraceable then Tor is your best chance. The Onion City search engine makes it more of a risk for the owners of the illegal onion websites as they are now easier for law enforcement to find. Unless I am misunderstanding all of this which is quite possible.
The risk to owners of illegal .onion websites is probably unchanged – the .onion sites are still inside the Tor network and their true internet location is protected by it. It’s possibly a bit easier for law enforcement to discover those sites exist but it’s no easier for them to actually locate them.
And yes, users of Onion City are not inside the Tor network and are not afforded any protection whatsoever.
Contradiction,read the top,then the bottom male up ur mind!
OnionCity users: not protected by Tor
Hidden service websites: protected by Tor
Good article! We approve.
What if we use onion city from a tor browser. wouldn’t that give us the best of both worlds? privacy and search ability?
In that scenario, yes, you are anonymised by Tor and it acts as a proxy. As far as Onion City is concerned you are whichever exit node your Tor circuit is using.
However the advantage of Onion City is that it’s on the regular web. If you’ve got Tor you don’t need it, you can visit the .onion version of DuckDuckGo.
Jaxon, I believe the answer to your question is no. Although the author included mention of both the secure TOR network and the unsecured onion city search engine, it would be easy to logically place the onion city search engine inside the TOR network. Sadly, if you use onion city it’s like being naked in your front yard with all your neighbors staring at you…
I think you’re wrong, actually. Using Tor Browser does, indeed, protect you if you use onion.city with it. Tor itself provides the protection so if you’re using g it, you’re protected. You are only not protected from it if you use a browser not through the Tor network.
Exploiters never miss a trick. Help innocent people from those exploits. Empower the people by empowering TOR and EFF.
this is a bit a squawk-a-do…
in the article it says owners can opt out of the onion city..
i would imagine if anyone was doing something illegal they would opt out of onion city.
and i guess the people who invented onion city will most likely be blacklisted, if known to the Tor community..
isn’t the name of the game with Deep/Dark web.. sort “need to know” or privileged access?
thus making onion city a no no in that world…
just thoughts.. not truths…