Kafka Jobs - March 2021

Cookpad | Data Engineer | Bristol, UK | REMOTE currently, relocation assistance available, ONSITE option (post Covid-19) | Full time | Visa sponsorship

Cookpad is the world’s largest recipe sharing service, with over 100M monthly users globally. This is an opportunity to join the Global division of Cookpad, which is headquartered in Bristol (United Kingdom), and is responsible for 30+ languages, 70+ countries, and over TBs of data per day.

Cookpad is growing its Data Engineering capability and is looking for experienced data engineers with a solid background of data pipelines (ETL), data warehousing and data intensive software development who want to help build the company-wide data infrastructure. Particularly of interest are engineers who have previously worked on MPP DB like Redshift or BigQuery. Experience with a streaming platform like Apache Kafka is welcomed as we have plan to add streaming capability to our data infrastructure.

The team is working from home currently. Remote welcome, timezone-dependent. Relocation welcome. Relocation assistance available.

Please contact me if you have any questions: shimpei-kodama@cookpad.com Learn more about the role and apply: https://apply.workable.com/cookpad/j/26D6344C1F/ Learn more about Cookpad’s mission to make everyday cooking fun: https://www.cookpadteam.com/

DevOps Engineer - www.xtelligent.io/about | LA | Full-time (PT/Contract Considered) | Remote

We are a connected vehicle / smart cities infrastructure company working on fun projects (think major cities, Olympics, and top-tier automotive partners). We are looking for support developing scalable data and IoT enabled technologies to improve city transportation system operations, safety, and sustainability. To that end, we are looking to bring on a great DevOps engineer with several years of experience.

The DevOps engineer should have Kubernetes and AWS experience. Experience with Kafka, Bash, Python, Cloudformation, Prometheus, Ansible, Troposphere (or Terraform), Helm is also helpful. The right candidate is self-motivated, excited to solve highly technical problems, and able to operate independently.

Email me at mike [at] xtelligent.io if interested.

Thanks!

Zemanta, an Outbrain company| Backend Engineer | Full-time | On Site (currently working remotely & planning hybrid mode in near future)| Ljubljana, Slovenia

We're looking for a versatile backend engineers with solid experience in at least one statically typed programming language to help us build and grow our partner integration service (bonus: experience with NoSQL databases, Hadoop, Kafka, Docker & working with clients or product managers)

We're building the most advanced native advertising platform in the world and solving hard problems (1.3M qps, tens of TB data/day, 150M+ predictions per sec).

We care deeply and invest heavily into our team, setting everybody up for growth and success. In addition to being a part of a great team, working in a fast-paced environment, learning from other smart people and skyrocketing your skills, we offer: - international environment - attractive salary package + stock options plan - attending world's leading software engineering conferences - flexible working hours, wfh - gym membership & free weekly lunch

Apply here: https://apply.workable.com/zemanta/j/0A13CB0EC4/

Man Group Alpha Tech | Quant Python Engineer | London, UK | Onsite | Full Time

As a Quant Python Engineer in Alpha Tech at Man you will be building the tools, frameworks, libraries and applications which power our Quantitative Research and Systematic Trading. This includes responsibility for the continued success of “Raptor”, our in-house Quant Platform, next generation Data Engineering, and evolution of our production Trading System as we continually expand the markets and types of assets we trade, and the styles in which we trade them. Your challenges will be varied and might involve building new high performance data acquisition and processing pipelines, cluster-computing solutions, numerical algorithms, position management systems, visualisation and reporting tools, operational user interfaces, continuous build systems and other developer productivity tools.

Our systems are almost all running on Linux and most of our code is in Python, with the full scientific stack: numpy, scipy, pandas, scikit-learn to name a few of the libraries we use extensively. We implement the systems that require the highest data throughput in Java. For storage, we rely heavily on MongoDB and Oracle.

We use Airflow for workflow management, Kafka for data pipelines, Bitbucket for source control, Jenkins for continuous integration, Grafana + Prometheus for metrics collection, ELK for log shipping and monitoring, Docker for containerisation, OpenStack for our private cloud, Ansible for architecture automation, and HipChat for internal communication. But our technology list is never static: we constantly evaluate new tools and libraries.

Alpha Tech has a small company, no-attitude feel. It is flat structured, open, transparent and collaborative, and you will have plenty of opportunity to grow and have enormous impact on what we do. We are actively engaged with the broader technology community.

o We host and sponsor London’s PyData and Machine Learning Meetups o We open-source some of our technology. See https://github.com/man-group o We regularly talk at leading industry conferences, and tweet about relevant technology and how we’re using it. See @manquanttech Essential Skills o Exceptional technology skills; recognised by your peers as an expert in your domain o A proponent of strong collaborative software engineering techniques and methods: agile development, continuous integration, code review, unit testing, refactoring and related approaches o Expert knowledge in one or more programming languages, preferably Python, Java and/or C/C++ o Proficient on Linux platforms with knowledge of various scripting languages o Strong knowledge of one or more relevant database technologies e.g. Oracle, MongoDB o Proficient with a range of open source frameworks and development tools e.g. NumPy/SciPy/Pandas, Pyramid, AngularJS, React o Familiarity with a variety of programming styles (e.g. OO, functional) and in-depth knowledge of design patterns.

If you're interested, please get in touch with Milly Parrott milly.parrott@man.com

Aiven.io | Solutions Architect(s) | Remote (EU, US and Canada) | Full-time | https://aiven.io

Aiven is a managed service offering open source, multi-cloud data pipelines using software like Apache Kafka, PostgreSQL, Cassandra and M3DB.

I am one of the Solutions Architects in the EU and have been with the company for just over a year. We have seen some huge growth in the past few years and the pandemic accelerated that somewhat. My team is looking for 1 more Solutions Architect and the US side has 2/3 open positions.

Working cross-cloud with Python, Go, Kubernetes and Terraform, as well as being involved with a bunch of interesting use cases for the services we offer and using your expertise to advise new/existing customers.

If you want more info (or see other positions), we have a pretty sizeable list (including less technical roles) here: https://apply.workable.com/aiven/ or you can contact me directly: chrisg (at) aiven (dot) io

Navio | DevOps Lead, Senior Backend Engineers, UX | ON SITE (post covid) or REMOTE | Portland or Bay Area | Full Time | Navio.com/careers

Navio is a seed-stage company building software tools that help cancer patients and their doctors navigate to a better standard of care. Ultimately, we’ll change the narrative around highly lethal cancers like Glioblastoma, where standard treatment offers no hope.

Navio’s development team is remote-first with foci in Portland and the Bay. We use modern tools like such as Kotlin, React, GraphQL, Kafka and Elasticsearch and run at AWS using Terraform Infrastructure as Code, Docker / ECS, RDS Postgres, Lambda / Serverless, etc. We’re unencumbered by legacy code and are writing our systems from the ground up the right way.

Navio is hiring for

* DevOps Lead

* Backend Engineers

Are you ready to build something that truly benefits people? Come do meaningful work in a fun, fast-paced environment. We offer competitive benefits and stock options. careers at navio.com

Viooh | Data Engineer | London | Remote or onsite (flexible) | Full Time

Viooh works with different partners like JCDecaux. Formed in January 2018 as an independent company, we have grown from 5 people to 100 now. We kept a healthy growth in 2020 despite the pandemic and we have even bigger plans for 2021. Our team of data engineers plays a pivotal role in this growth and helping shape the future of automated OOH and programmatic digital OOH advertising.

I'm a data engineer in a team of 7 from diverse backgrounds. We look after end-to-end analysis, testing, and production releases which can happen multiple times a day. We use Clojure, Kafka, and AWS as our main tools. We published some projects on GitHub https://github.com/VIOOH?q=&type=source and we plan to open source more including a build system (Clojure on AWS Lambdas with Slack integration), and a Terraform Kafka module. Our data infrastructure for production handles a daily average of 4 billions Kafka messages which are then made available in a data lake for reporting, analytics, fault-tolerance or replay. Users span across multiple markets all over the world, so you are going to love to see your work used at scale . We also work on providing high availability for our services and robust monitoring.

From a human standpoint, we have a diverse team. We are the active parts of our team, and we favour human ties and focus on our health – even more during lockdowns. You don't have to already know Clojure to join us, but you should be keen to learn and have software engineering/ops experience. You can also read about our values here: https://www.viooh.com/careers

If you want to know more, drop me an email at piotr-yuxuan@viooh.com. Direct applicants only, no consulting firms.

Segment by Twilio | Engineering | SF, NYC, Vancouver | Full-Time | Onsite & Remote (US & Canada)

Segment is building the customer data platform for everyone. We transform data and route to over 200 different integrations, adding new ones every day. We're processing billions of events daily and maintain the analytics infrastructure for Fortune 500s. Recently acquired by Twilio, we've increased our hiring velocity substantially. Our goal is to help companies learn from how their users interact with the products to build even better products. We also like to share our work and what we learn, here are some examples:

Sokanu | Multiple Roles | Onsite or NA Remote (all remote for now) | Vancouver, Canada | Full-time

Serving over 10 million people per year, we use psychometrics and modern data science to help people discover their best-fit careers and give them the tools they need to make that career a reality. We're a small team with a modern tech stack looking to grow our team as we enter a new stage for the company. We'd prefer (eventually) on-site in Vancouver, BC but are open to remote hires for the right fit.

Roles we're hiring for at the moment:

– Senior Front-end Engineer: Typescript/React. Help us create and deploy our new design system, provide mentorship, and improve our stack and toolchain as we grow.

– Infrastructure Engineer: Terraform/AWS/ECS. Help us develop and maintain our systems and DevOps culture as we expand and grow.

– Data Engineer: Kafka/Databricks/Spark (TBD). Help us build and maintain new data pipelines to expand the potential of our data science initiatives.

– Full-stack Engineer (Growth): Python/Typescript. Help us continue to grow by finding both technical and product opportunities, running AB tests, and working closely with our data science and marketing teams.

If you're interested in what we're doing, send us an email to hiring@sokanu.com with a resume/GitHub and let's chat!

Ladder | Software Engineer | Clojure, Clojurescript, AWS | Palo Alto, CA | https://www.ladderlife.com

Ladder is building life insurance for consumers: instant, simple, and smart. We're looking for software engineers who are excited to help us reimagine what life insurance can be. Our tech stack includes Clojure(script), Datomic, Kafka & AWS. Read the full job description and apply here: https://grnh.se/d9f5b5cc1us

Salesforce | Distributed Systems / Backend | Multiple Levels | San Francisco, Palo Alto, Remote | $150k+ | Full Time | Visas Come help Sales Cloud find Insights from its activity data. The Activity Insights team is responsible for running machine learning and heuristic models on top of the massive data set that is Salesforce. We not only generate Insights but are own the alerting engine for the new High Velocity Sales product. Work closely with data science, product management, user interface, and infrastructure teams to build the scalable and intelligent future of CRM software. Tech: Kotlin, Scala, Storm, Spark, Cassandra, Postgres, Kafka, GraphQL, TensorFlow Serving, Docker, and more, all running in Amazon Web Services. Contact: s.young@salesforce.com

WalmartLabs | Staff Software Engineer (Clojure) | REMOTE (US only) | Full-time

We're a small and friendly team operating within Walmart; we're focused on delivering great value to Walmart's customers, as well as our internal clients. Members of the team are self-motivating, curious, and have a hands-on attitude, and take pride in their work and accomplishments. We use the Clojure programming language, almost exclusively, to ensure that our servers are fast and very stable; we use GraphQL and good old-fashioned conversation to keep our internal clients informed, engaged, and productive.

Our team's primary mission is giving customers access to their online and in-store purchase history; this includes receiving and storing a constant feed of receipt information from thousands of Walmart and Sam's Club stores.

Our daily cycle includes a brief "standup" meeting to ask questions, check on progress, call out interesting problems and solutions, and otherwise keep in touch. We try to keep the rest of the day free from meetings, to actually get things done.

Because we are, and always have been, a remote-first team, we rely on good communication: both in writing, and via video.

We have full ownership of, and responsibility for, the life-cycle of our code, and the servers that code runs on, as well as monitoring tools. We deploy on a daily basis, and we continually work to improve our DevOps tools and processes.

Our systems sit between front-end developers building web pages and mobile apps, and other back-end teams and their APIs; an important part of the job is working out the best solutions that address the needs of both sides, then implementing those solutions with a focus on stability and scalability. We expect you to have a good intuition for building systems that meet our clients' needs but won't fail under pressure.

Candidates should be able to demonstrate the ability to think and work in Clojure.

Skills list / technical stack: Clojure, GraphQL, Cassandra, Kafka, Elasticsearch, Redis, Prometheus, Ruby, Ansible, Spark, Docker, JVM

If this sounds good, please apply through our LinkedIn post https://www.linkedin.com/jobs/view/2403594484/?capColoOverri... (preferred) or email me at bcarrell@walmart.com.

Smarkets | Full Time | ONSITE [REMOTE during the plague] (London, UK; also Downtown LA, California)

We're a modern betting exchange, going technology first to enable proper price competition in a field of fat commissions. Join a small and agile team in our beautiful office in St. Katharine Docks. If our US location tickles your fancy, you get to help a sunny satellite office too. For the time being, thanks to Covid, we are in fully remote mode.

Smarkets develops a reliable, low-latency, highly concurrent betting exchange based on trading exchange designs. We're also building a fast, modern web interface to allow for a smoother experience. Servicing our users is top priority.

The Smarkets platform is written predominantly in Python, C++ (replacing still present Erlang[ß]) and Javascript for React & React-Native, relying heavily on asynchronous programming techniques. The tech stack sports Kafka, Postgres and Kubernetes. We use REST where we can, and gRPC where we can't. Life at Smarkets circles around people, version control, configuration management and automation. We can - and do - deploy to production several times a day.

Production environment is in AWS. In fact, Smarkets was the first gambling operator under the Maltese regulator to get permission to run everything in the cloud. We push the envelope where needed and educate auditors when necessary.

We are looking for engineering talent all across the board: frontend and mobile, infrastructure, data science, trading engine, security - and of course generalists, those yet to find their calling.

If you like the idea of flat structure and practical engineering approach, see our jobs at https://smarkets.com/careers .