spider.io: Software engineer (Bot-or-Not)

---

Startup   NoSQL   London   Cloud computing   Distributed computing   Stream processing  

---

Competitive salary / Spider Towers. West End, London

Description

 

Bot-or-Not

 

Spider.io polices the web, distinguishing web robots from legitimate human website visitors.

 

Our systems analyse tens of billions of pageviews in real time. Each and every day we face increasingly difficult challenges, as we look to outwit the talented, devious, extremely motivated engineers who look to reverse-engineer our efforts.

 

Who are you?

 

You are an exceptional engineer, and you want to roll your sleeves up and get stuff done. You want to work in a small company where your input will make a material difference to both the company's direction and ultimate success. You are not just a cog in a machine: you do not want to be a nameless suit, and you do not want that you are simply told what to do. You get excited about building new things and taking projects from conception to production.

 

What will you be working on?

 

You will be responsible for designing, implementing, advancing and maintaining an efficient, scalable architecture to support the collection and analysis of tens of billions of web requests per month. You will work on a broad range of projects: from scalable NoSQL databases and high-availability distributed stream processing to test, configuration and monitoring systems which allow for a Chaos Monkey to try wreak havoc.

 

You will be encouraged to review, discuss and apply advances in the field, to rapidly produce proof of concept solutions, and to select the most appropriate technologies and approaches for each new challenge.

 

Showing off your skills?

 

— A computing PhD (or related), high TopCoder rating or 5+ years experience

— A publicly accessible code repository

 

Apply Now