Internal Application: Search Engineer
Engineering | Mountain View, CA | Full Time
At Diffbot, we believe that access to structured information will be the critical resource for the coming wave of intelligent applications—for everything from new app experiences, to search assistants, to enterprise business intelligence.
That’s why our team of world-class AI engineers is building a machine that can autonomously synthesize the world’s largest database of structured information and looking for those that want to join us on this mission.
Diffbot uses a commercial version of the Gigablast search engine and crawler, written in C++, to discover web pages for processing. Once Diffbot has converted these web pages to JSON, they are then indexed for searching. Efficiently crawling the web using a distributed cluster of servers is a continuing challenge. Implementing innovative algorithms to improve the quality and performance of the search function is another.
As a Search Engineer at Diffbot you will be part of an elite team building the world’s largest database of structured knowledge.
Improving performance and reliability of search infrastructure
Experience in C/C++ and Linux
Experience writing algorithms for speed and scalability
Experience with Github
Experience with datacenter operations & monitoring
To apply, please submit:
Resume / LinkedIn / homepage
A short self-introduction (describe your interest and area of speciality)
How did you hear about Diffbot?