DARPA shows off its tech for indexing the deep web

On Sunday night, 60 Minutes aired a segment about the Defense Advanced Research Projects Agency, or DARPA, and its attempts to secure the internet from hackers, human traffickers and other criminals. One of the DARPA efforts the program highlighted — and did so even more in an unaired segment for the web — is a project called Memex, which is essentially a search engine for the deep web and the dark web.

The technology looks pretty amazing in a number of ways, including its scale, its speed and its interface. Of course, it’s also tackling a horrible and often under-appreciated problem, which is the illegal trafficking of women and girls as sex objects. Asked why DARPA is concerned with sex trafficking, Memex inventor Chris White explained that people willing to take part in that endeavor are often more likely to take part in other endeavors — including things like weapons or drug trafficking — that could have national security implications.

A Memex-generated map of sex trafficking.

A Memex-generated map of sex trafficking.

I wrote briefly about Memex last month, as part of a post about DARPA-funded research into machine learning algorithms — including computer vision and text analysis algorithms — for extracting even more info from deep web content.

The work DARPA is doing is part of a larger effort, which also includes tech companies like Google and Palantir, to identify and map instances of human trafficking around the world. It’s one of many problems that has existed for a long time, but that the internet has made easier to engage in. However, these efforts and others also show how the internet is making it easier for law-enforcement agencies to track and prosecute these crimes, provided the right analytical techniques are in place.

The 60 Minutes segment also featured DARPA innovation head Dan Kaufman, who spoke about web security at our Structure conference last June.


Computers and networks are under attack! (charts)

Distributed denial of service attacks are on the rise, so who is being targeted and what is actually causing service outages ? Arbor Networks released data answering these questions and more.

6 ways big data is helping reinvent enterprise security

What’s true in the rest of the world is true for security software, as well: more data means more intelligence. Thanks to the emergence of new techniques for storing, collecting and analyzing data, there’s a new wave of security companies looking smarter than ever.

GreenSQL gets $5.9M for database security

GreenSQL, an Israeli-based startup that offers software that secures databases has raised a second round of funding led by Rhodium and Atlantic Capital Partners. The funding will allow the company to expand to the U.S. and build products for NoSQL tools used today.

Security is the next killer app for Hadoop

The open-source, data-processing tool Hadoop is already popular for a variety of use cases that can benefit from clusters of machines churning through unstructured data — such as search engines and social-media analysis — and now it’s turning its attention to security data.

Jumio says use your webcam to swipe credit cards

Jumio, a secretive online-payments startup created by Jajah founder Daniel Mattes, is finally ready for its close-up. And it’s a fitting metaphor, because Jumio is enabling online credit card payments made by scanning a card with a computer webcam.

5 companies using web data to fight cybercrime

Yesterday, Google announced a new feature that alerts web surfers when their PCs might be infected with malware, but it’s hardly the only company using big data to fight cybercrime. We’ve covered a handful of them of over the past couple years.