Engineering team lead

Engineering team lead Apify's mission is to help anyone get more value from the web with automation, AI agents, and web scraping. Why? We believe that humans have better things to do than filling forms, compiling huge Excel sheets of copy-pasted data, or watching thousands of videos to determine whether they include a specific brand logo. Those are jobs for machines. And just as in the real world we have tools that make our lives easier, we should have tools to make our lives easier on the web. Web automation has a profound impact. Our users automate service unsubscriptions https://www.rocketmoney.com/feature/manage-subscriptions to save people money, and they collect billions of rows of data from all over the world for AI training https://blog.apify.com/intercom-customer-support-ai-chatbot-web-scraping/, protection of consumers https://blog.apify.com/how-web-scraping-ai-and-the-eu-have-come-together-to-sweep-away-fake-discounts-in-europe/, or finding lost children https://apify.com/success-stories/fighting-child-traffickers-with-technology. We give AI chatbots https://blog.apify.com/intercom-customer-support-ai-chatbot-web-scraping/ the context to interact intelligently, and we’re developing novel ways to work with generative AI like ChatGPT https://blog.apify.com/add-custom-actions-to-your-gpts/. We run a distributed platform that executes over 30 Actor runs (think Docker containers) per second, along with thousands of API requests per second. In this position, you will help us design and build the future of the Apify platform to keep up with our growth. You will be a hands-on leader of one of our 8 product teams that focuses on the core services of the Apify Platform. WHAT YOU’LL BE WORKING ON: - Lead a team of ±5 engineers (including you). - Facilitate team meetings and ensure the team operates smoothly. At Apify, there are no Scrum Masters; we manage our own work. - Specify goals for the team and take responsibility for their delivery. - Guide junior (and senior) team members and help them grow. - Participate in hiring new engineers for your team to help Apify scale. - Collaborate with other team leaders, engineering managers, and the CTO on setting and improving processes in Apify engineering. - Actively develop new features in our backend services and solve complex scalability challenges. - Thoughtfully introduce new technologies and best practices into our codebase. MAIN FEATURES AND SERVICES YOUR TEAM OWNS: - Apify API - the public API powering the core logic of the platform, processing up to 10,000 requests per second. - Datasets, key-value stores, request queues - platform storage for storing (not only) scraped data. Based on AWS S3 and DynamoDB, containing 100s of TBs of data, with complex IAM systems, retention policies, and a Redis-based buffering system to handle high loads. - Actor Standby - a custom job orchestrator that runs scrapers as real-time APIs with advanced autoscaling. OUR TECH STACK: - Frontend: React.js, styled-components, Storybook, Cypress, Playwright - Backend: TypeScript/Node.js, Next.js, Nest.js, Express.js, Docusaurus, Jest - Infra: AWS, Kubernetes, Helm, MongoDB, Redis, DynamoDB, S3, GitHub Actions - Monitoring: Grafana, Prometheus, Mezmo, Sentry, PagerDuty - Tools: GitHub, ZenHub, Notion, Google Workspace - Process: two-week sprints, code reviews, tests, automating whatever we can, and deploying multiple times per day. THEY SAY THERE ARE NO PERFECT CANDIDATES, BUT YOU MIGHT BE THE ONE IF YOU HAVE: - Strong engineering experience, ideally overlapping with the backend services in our tech stack. - Experience leading successful product engineering teams. - Skills in giving feedback and communicating goals. - A passion for learning, continuous improvement, and supporting others. - Good communication skills in English. WHY SHOULD YOU WORK AT APIFY? - Space, support, and autonomy for personal growth, with a direct impact on our success - Full-time position in P ... (truncated, view full listing at source)