Who We Are:
We build infrastructure that delivers massive amounts of web data to the companies training the world’s most powerful AI models.
We're the team that helps to power and support Grass, a bandwidth-sharing network that lets us operate a massive distributed crawler, giving us unique access to high-quality public web data at global scale. On top of that, we’ve built pipelines for ingesting, segmenting, and annotating billions of videos, transcripts, and audio files, powering dataset creation for frontier labs.
We’re lean, technical, and move fast. No red tape, no slow decision-making; just a team of builders pushing to expand what’s possible for open web data and AI.
The Role.
We are seeking a Web Scraping Specialist who is proficient and brings significant experience in data extraction and web scraping techniques. You will join a small, specialized team and lead efforts to gather and analyze data, optimize scraping processes, and support our vision for a future where Grass plays a crucial role in transforming internet data accessibility.
Please note: This role requires a work schedule that sufficiently overlaps with EST business hours to collaborate effectively with the team.
Who You Are.
Demonstrated ability to extract data from complex websites with minimal supervision, with a portfolio or examples of past projects.
Proficiency in languages such as Python or JavaScript, with strong skills in libraries and frameworks like BeautifulSoup, Scrapy, or Selenium.
Knowledge of asynchronous programming, multithreading, and distributed scraping.
In-depth knowledge of HTML, CSS, JavaScript, and the Document Object Model (DOM).
Experience with NoSQL databases (MongoDB, Cassandra), capable of designing efficient storage solutions and managing data integrity.
Ability to apply machine learning algorithms for data cleaning, categorization, or predictive analysis adds significant value.
Experience with cloud services (AWS, Google Cloud, Azure) for deploying and managing scraping jobs at scale.
Active participation in open-source projects related to web scraping, data processing, or similar fields.
What You'll Be Doing.
Write, test, and refine code that extracts data from various online sources, ensuring reliability and efficiency.
Perform data retrieval tasks, handling complexities such as pagination and dynamic content loaded with AJAX.
Clean and format extracted data, ensuring it meets quality standards for further analysis or processing.
Database management: Store and manage the scraped data in appropriate databases, optimizing for access speed and data integrity.
Regularly monitor the scraping processes, identify and resolve any issues to maintain continuous data flow.
Why Work With Us:
Opportunity. We are at the forefront of developing a web-scale crawler and knowledge graph that improves access to public web data and extends the value of AI to the people.
Culture. We're a lean team with a high bar. We come to work not to be comfortable, but to find out what we're capable of and to do work that matters. We're not calling for people who keep things moving. We're calling for people who make everyone around them better.
We prioritize low ego and high output. This is a fully remote team.
Compensation. You’ll receive a competitive salary, benefits and equity package.
Who We Are:
We build infrastructure that delivers massive amounts of web data to the companies training the world’s most powerful AI models.
We're the team that helps to power and support Grass, a bandwidth-sharing network that lets us operate a massive distributed crawler, giving us unique access to high-quality public web data at global scale. On top of that, we’ve built pipelines for ingesting, segmenting, and annotating billions of videos, transcripts, and audio files, powering dataset creation for frontier labs.
We’re lean, technical, and move fast. No red tape, no slow decision-making; just a team of builders pushing to expand what’s possible for open web data and AI.
The Role.
We are looking for a talented Network Infrastructure Engineer to join our team with experience working with infrastructure and network architecture design . In this role, you will be responsible for building and maintaining the infrastructure that powers our AI-driven platform. You will work closely with our engineering and product teams to deploy physical infrastructure at our data centre to ensure that our systems are scalable, secure, and reliable. Your work will directly impact the efficiency and performance of our platform, enabling us to deliver cutting-edge solutions at scale.
Who You Are.
Proven experience designing networks and maintaining physical infrastructure.
Possesses a deep understanding of routers/switches and establishing connectivity between servers.
Strong proficiency with infrastructure as code (IaC) tools such as Terraform, Ansible, or similar.
Experience with cloud platforms like AWS, GCP, or Azure, including networking, security, and automation.
Experience with high-performance storage solutions, namely MinIO.
Proficiency in containerization technologies (e.g., Docker) and orchestration tools like Kubernetes.
Solid understanding of monitoring and logging tools such as Prometheus, Grafana, or ELK stack.
Strong problem-solving skills with a focus on performance optimization and automation
What You'll Be Doing.
Infrastructure Design and Implementation:
Oversee design, configuration, and deployment of networks, servers, network switches, systems, firewalls, and applications.
Oversee the configuration of servers with virtualization and the troubleshooting of application issues
Ensure infrastructure solutions meet business needs, including scalability and security.
System Maintenance and Support:
Ensure regular maintenance of servers, networks, and other infrastructure components to ensure uptime and reliability.
Troubleshoot and resolve issues related to infrastructure components.
Network Management:
Ensure correct configuration of network components, including switches, routers, firewalls, and VPNs.
Monitor system performance and implement solutions to enhance reliability, security, and scalability.
Collaborate with engineering teams to integrate DevOps best practices into the development lifecycle.
Ensure that all systems are secure and compliant with industry standards.
Why Work With Us:
Opportunity. We are at the forefront of developing a web-scale crawler and knowledge graph that improves access to public web data and extends the value of AI to the people.
Culture. We're a lean team with a high bar. We come to work not to be comfortable, but to find out what we're capable of and to do work that matters. We're not calling for people who keep things moving. We're calling for people who make everyone around them better.
We prioritize low ego and high output. This is a fully remote team.
Compensation. You’ll receive a competitive salary, benefits and equity package.
Who We Are:
We build infrastructure that delivers massive amounts of web data to the companies training the world’s most powerful AI models.
We're the team that helps to power and support Grass, a bandwidth-sharing network that lets us operate a massive distributed crawler, giving us unique access to high-quality public web data at global scale. On top of that, we’ve built pipelines for ingesting, segmenting, and annotating billions of videos, transcripts, and audio files, powering dataset creation for frontier labs.
We’re lean, technical, and move fast. No red tape, no slow decision-making; just a team of builders pushing to expand what’s possible for open web data and AI.
The Role:
We are looking for a Machine Learning Engineer with strong skills and significant experience developing machine learning models. You will join a small, innovative team and lead efforts to advance our capabilities, drive model development, and support our vision for a future where Grass is transformative in the internet's evolution.
Please note: This role requires a work schedule that sufficiently overlaps with EST business hours to collaborate effectively with the team.
Who You Are:
Bachelor’s, Master’s, or Doctoral degree in Data Science, Computer Science, Statistics, or a related field.
A minimum of 3 years of work or research experience dealing with large datasets.
Experience working with large-scale text datasets, NLP pipelines, or data preparation for LLM training is highly preferred.
Strong coding skills in Python or other object-oriented programming languages.
Experience with text deduplication, dataset filtering, corpus curation, or data distillation is a strong plus.
Graduate-level knowledge of statistics, including but not limited to hypothesis testing, regression analysis, and probability.
Excellent work ethic and the ability to thrive in a fast-paced startup environment.
Strong problem-solving skills and attention to detail.
Good communication skills, with the ability to articulate complex data concepts to non-technical stakeholders.
Experience working in a high-output team.
What You'll Be Doing:
Developing data processing pipelines and machine learning solutions for large-scale NLP and LLM applications, including improving the quality, filtering, and preparation of training datasets.
Designing and implementing pipelines for processing and analyzing large datasets.
Analyzing and interpreting complex time series data to provide actionable insights and solutions.
Designing, implementing, and maintaining data-driven models and algorithms.
Developing techniques for dataset curation to improve the quality and efficiency of AI training data.
Building scalable pipelines for filtering, deduplicating, and improving large-scale text datasets used for LLM training.
Collaborating with cross-functional teams to understand data needs and deliver timely solutions.
Ensuring data quality and integrity throughout all processes.
Utilizing Optical Character Recognition (OCR) technology to convert different types of documents into editable and searchable data.
Continuously researching and implementing best practices in data science and machine learning.
Contributing to the development and improvement of internal data processing tools and infrastructure.
Why Work With Us:
Opportunity. We are at the forefront of developing a web-scale crawler and knowledge graph that improves access to public web data and extends the value of AI to the people.
Culture. We're a lean team with a high bar. We come to work not to be comfortable, but to find out what we're capable of and to do work that matters. We're not calling for people who keep things moving. We're calling for people who make everyone around them better.
We prioritize low ego and high output. This is a fully remote team.
Compensation. You’ll receive a competitive salary, benefits and equity package.
Who We Are:
We build infrastructure that delivers massive amounts of web data to the companies training the world’s most powerful AI models.
We're the team that helps to power and support Grass, a bandwidth-sharing network that lets us operate a massive distributed crawler, giving us unique access to high-quality public web data at global scale. On top of that, we’ve built pipelines for ingesting, segmenting, and annotating billions of videos, transcripts, and audio files, powering dataset creation for frontier labs.
We’re lean, technical, and move fast. No red tape, no slow decision-making; just a team of builders pushing to expand what’s possible for open web data and AI.
The Role:
We’re seeking a Growth & Communications Lead to tackle the challenge of shrinking online attention spans. You will help identify, develop, and execute strategies to drive user acquisition and shape our external narrative. This role demands the ability to craft clear, compelling, and on-brand messaging that cuts through the noise across all channels. Success hinges on refined judgment for tone and resonance combined with rapid experimentation to scale our network while also articulating our mission.
Please note: This role requires a work schedule that sufficiently overlaps with EST business hours to collaborate effectively with the team.
Who You Are:
A strong, versatile copywriter who can turn complex ideas into clear, engaging, and persuasive language.
Curious and passionate about growth, experimentation, and user behavior.
Embraces feedback as a tool for continuous improvement.
Innovative thinker who thrives in fast-paced environments.
Creative problem solver and strong communicator.
Comfortable balancing short-term wins with long-term strategy.
Persistent and resourceful in solving challenges.
High integrity and seeks out responsibility.
Resilient, motivated to get things done, and eager to learn.
Values team success over personal recognition; organized, detail-oriented, and process driven.
What You'll Be Doing:
Owning copywriting across key channels (email, landing pages, in-product copy, social, blogs, and campaigns) to drive user acquisition, activation, and engagement.
Identifying and analyzing growth opportunities across user acquisition, and engagement channels.
Building relationships with influencers, creators, and various internet communities to amplify brand visibility and drive adoption, including writing briefs and suggested copy.
Managing and optimizing paid acquisition campaigns across major ad platforms (e.g., Meta, Google Ads) to scale growth efficiently.
Tracking and analyzing KPIs (CTR, conversion rate, engagement, etc.) to measure the impact of copy and inform decisions.
Developing and framing the company's brand position, narrative, and tone across various social and digital platforms.
Shaping how we show up online through consistent, thoughtful, and on-brand messaging.
Blending deep technical understanding with creative storytelling to explain our mission, products, and business model.
Creating unexpected ways to showcase our work, including our open source initiatives and research.
Creating multi-format educational content (short-form, long-form, visual-supporting copy) for a variety of audiences and depth levels.
Skills, Requirements and Qualifications:
Bachelor’s degree or equivalent work experience
Minimum of 2 years of experience in a growth, marketing, communications, or creative role with a primary focus on copywriting
A strong portfolio demonstrating clear, persuasive, and results-driven copy across multiple formats (email, web, social, product, campaigns).
Exceptional written communication skills; you are an excellent writer and editor with high attention to detail, tone, and clarity.
Strong analytical skills with experience using data to test, measure, and iterate on copy and campaigns.
Ability to manage multiple projects, deadlines, and priorities simultaneously.
Uses first principles and systems thinking to understand and solve problems.
Strong interpersonal skills; you are personable and able to manage expectations across many stakeholders and multiple ongoing relationships.
Ability to work under pressure, meet deadlines, and adapt quickly based on feedback and performance data.
Strong strategic thinking and problem-solving skills; comfortable moving between high-level narrative and tactical execution.
Why Work With Us:
Opportunity. We are at the forefront of developing a web-scale crawler and knowledge graph that improves access to public web data and extends the value of AI to the people.
Culture. We're a lean team with a high bar. We come to work not to be comfortable, but to find out what we're capable of and to do work that matters. We're not calling for people who keep things moving. We're calling for people who make everyone around them better.
We prioritize low ego and high output. This is a fully remote team.
Compensation. You’ll receive a competitive salary, benefits and equity package.
Who We Are:
We build infrastructure that delivers massive amounts of web data to the companies training the world’s most powerful AI models.
We're the team that helps to power and support Grass, a bandwidth-sharing network that lets us operate a massive distributed crawler, giving us unique access to high-quality public web data at global scale. On top of that, we’ve built pipelines for ingesting, segmenting, and annotating billions of videos, transcripts, and audio files, powering dataset creation for frontier labs.
We’re lean, technical, and move fast. No red tape, no slow decision-making; just a team of builders pushing to expand what’s possible for open web data and AI.
Overview:
As a Research Crawling Engineer, you will design and operate large-scale web data acquisition systems for research and model development. Your work will span distributed systems, scraping infrastructure, and data pipelines.
Please note: This role requires a work schedule that sufficiently overlaps with EST business hours to collaborate effectively with the team.
Responsibilities:
Build and maintain large-scale web crawlers across diverse domains
Design high-throughput, fault-tolerant systems for data collection (millions to billions of URLs/day)
Handle anti-bot systems, rate limits, and dynamic/JS-heavy sites
Develop pipelines for cleaning, deduplication, filtering, and normalization
Construct and maintain datasets for research and model training
Monitor crawl performance, coverage, and data quality; iterate quickly
Collaborate with research teams to align data collection with modeling needs
Optimize infrastructure for cost, latency, and reliability
Requirements:
Strong programming experience in one or more of: Go, Rust, Python, Java, or C++
Experience building web crawlers or large-scale data pipelines
Solid understanding of HTTP, networking, and browser behavior
Familiarity with distributed systems and parallel processing
Experience working with large datasets (TB–PB scale preferred)
Ability to debug unstable or adversarial environments
Preferred / Bonus:
Experience with NLP pipelines or dataset curation for ML
Familiarity with LLM pretraining data or retrieval systems
Experience with headless browsers (e.g., Chrome DevTools Protocol, Playwright, Puppeteer)
Knowledge of proxy systems, IP rotation, and large-scale request orchestration
Background in data quality evaluation or benchmarking
Experience running workloads on cloud or bare-metal infrastructure
What This Role Involves:
Operating at the boundary of scale and reliability
Adapting to constantly changing web environments
Balancing throughput, coverage, and data quality
Owning end-to-end data acquisition pipelines
Evaluation Criteria:
Ability to design systems that scale without degrading quality
Practical problem-solving under real-world constraints
Speed of iteration and ownership
Measurable improvements in data coverage, quality, or efficiency
Compensation:
Based on experience and demonstrated ability to operate at scale
Example Projects:
Build a distributed crawler for a continuously updated, high-quality web project
Design a system to classify and filter billions of pages for pretraining
Extract structured data from dynamic, JS-heavy sites at scale
Improve deduplication and quality scoring across multimodal datasets
Why Work With Us:
Opportunity. We are at the forefront of developing a web-scale crawler and knowledge graph that improves access to public web data and extends the value of AI to the people.
Culture. We're a lean team with a high bar. We come to work not to be comfortable, but to find out what we're capable of and to do work that matters. We're not calling for people who keep things moving. We're calling for people who make everyone around them better.
We prioritize low ego and high output. This is a fully remote team.
Compensation. You’ll receive a competitive salary, benefits and equity package.
Who We Are:
We build infrastructure that delivers massive amounts of web data to the companies training the world’s most powerful AI models.
We're the team that helps to power and support Grass, a bandwidth-sharing network that lets us operate a massive distributed crawler, giving us unique access to high-quality public web data at global scale. On top of that, we’ve built pipelines for ingesting, segmenting, and annotating billions of videos, transcripts, and audio files, powering dataset creation for frontier labs.
We’re lean, technical, and move fast. No red tape, no slow decision-making; just a team of builders pushing to expand what’s possible for open web data and AI.
The Role:
We are seeking a Senior Backend Engineer with deep expertise in backend development, particularly in data pipeline infrastructure. In this role, you will join a small, high-performing team to design and architect scalable systems, drive technical excellence, and help advance Grass’s role in shaping the future of the internet.
Please note: This role requires a work schedule that sufficiently overlaps with EST business hours to collaborate effectively with the team.
Who You Are:
7+ years of experience in software development, with a track record of writing high-quality, maintainable, and robust code.
Bachelor’s or Master’s degree in a STEM field, or equivalent practical experience.
Strong experience building and scaling large, distributed systems.
Deep expertise in designing, troubleshooting, and optimizing complex, live software systems.
Hands-on experience with modern development practices, including continuous integration and continuous deployment.
Strong analytical and problem-solving skills, particularly in diagnosing and resolving data flow and system performance issues.
Professional or native English proficiency.
What You'll Be Doing:
Design, build, and optimize scalable data pipeline infrastructure for real-time and batch data processing.
Develop new backend features and system improvements, focusing on reliability and performance.
Write clear, well-tested, and well-documented code.
Create and review technical designs, code, and documentation to maintain high engineering standards.
Contribute to Wynd’s infrastructure across mobile, desktop, and server-side systems.
Technologies Used:
Golang, Python, Redis Clusters, Kubernetes.
Why Work With Us:
Opportunity. We are at the forefront of developing a web-scale crawler and knowledge graph that improves access to public web data and extends the value of AI to the people.
Culture. We're a lean team with a high bar. We come to work not to be comfortable, but to find out what we're capable of and to do work that matters. We're not calling for people who keep things moving. We're calling for people who make everyone around them better.
We prioritize low ego and high output. This is a fully remote team.
Compensation. You’ll receive a competitive salary, benefits and equity package.
Who We Are:
We build infrastructure that delivers massive amounts of web data to the companies training the world’s most powerful AI models.
We're the team that helps to power and support Grass, a bandwidth-sharing network that lets us operate a massive distributed crawler, giving us unique access to high-quality public web data at global scale. On top of that, we’ve built pipelines for ingesting, segmenting, and annotating billions of videos, transcripts, and audio files, powering dataset creation for frontier labs.
We’re lean, technical, and move fast. No red tape, no slow decision-making; just a team of builders pushing to expand what’s possible for open web data and AI.
The Role:
We're looking for an early-career software engineer to help review our applications and ensure they meet compliance requirements before release. You'll be trusted to investigate application behavior independently, exercise sound judgment when identifying potential compliance issues, and take ownership of problems from discovery through resolution.
This role sits at the intersection of engineering, quality assurance, and compliance validation. You'll review product changes, investigate application behavior, identify potential compliance issues, document findings clearly, and work closely with engineering and operations teams to drive issues through resolution and verify that they’ve been properly addressed before deployment.
Please Note: This role requires a work schedule that overlaps sufficiently with EST business hours (online until 3:00 p.m. EST) to collaborate effectively with the team.
Who You Are:
You have hands-on programming experience with Rust and/or Java — even if limited.
You're a fast learner who can pick up unfamiliar systems, applications, and requirements quickly.
You have strong analytical instincts — you naturally notice inconsistencies and dig until you understand why something behaves the way it does.
You communicate findings clearly and professionally, both in writing and in conversation.
You take ownership: once you're given a problem, you see it through rather than waiting for direction at every step.
You're comfortable with ambiguity and change — you don't need a fixed checklist to know what to investigate next.
You enjoy working closely with engineering, product, and operations, and you don't need a narrowly defined lane to be effective.
What You'll Be Doing:
Review applications before release to ensure they meet defined requirements and identify potential compliance issues.
Understand and investigate application behavior in order to identify technical or compliance-related problems.
Validate application changes and document findings clearly.
Provide actionable feedback and communicate issues effectively to engineering and operations teams.
Work with engineers to understand and resolve identified issues.
Verify that issues have been properly addressed before release.
Maintain review documentation and contribute to improving internal review processes.
Help improve and, where appropriate, automate validation and QA workflows.
What We Are Looking For:
Develop a deeper understanding of our applications and systems over time and take increasing ownership of the review process.
Help ensure a consistent, high-quality release process across products.
Programming experience in Rust and/or Java (early-career level is fine — we care more about how quickly you learn and think through problems).
Experience in a startup or small engineering team, particularly where you had broad responsibilities.
Exposure to QA, testing, product validation, compliance, or security.
Excellent written and verbal English communication skills.
Ability to manage multiple reviews or tasks in parallel without losing track of details.
Why Work With Us:
Opportunity. We are at the forefront of developing a web-scale crawler and knowledge graph that improves access to public web data and extends the value of AI to the people.
Culture. We're a lean team with a high bar. We come to work not to be comfortable, but to find out what we're capable of and to do work that matters. We're not calling for people who keep things moving. We're calling for people who make everyone around them better.
We prioritize low ego and high output. This is a fully remote team.
Compensation. You’ll receive a competitive salary, benefits and equity package.
Who We Are:
We build infrastructure that delivers massive amounts of web data to the companies training the world’s most powerful AI models.
We're the team that helps to power and support Grass, a bandwidth-sharing network that lets us operate a massive distributed crawler, giving us unique access to high-quality public web data at global scale. On top of that, we’ve built pipelines for ingesting, segmenting, and annotating billions of videos, transcripts, and audio files, powering dataset creation for frontier labs.
We’re lean, technical, and move fast. No red tape, no slow decision-making; just a team of builders pushing to expand what’s possible for open web data and AI.
The Role:
We are seeking a hands-on Backend Engineer to join a small, dynamic engineering team and help build, improve, and operate the backend services and production tooling that support reliable web data acquisition at scale.
This role is ideal for someone who enjoys coding, cares about the quality of what they ship, and can work with a high degree of independence. You should be comfortable taking a high-level objective, figuring out what needs to be done, and driving it through to a reliable production result without requiring close supervision.
Please note: This role requires a work schedule that sufficiently overlaps with EST business hours to collaborate effectively with the team.
Who You Are:
Acts with integrity and seeks out responsibility
Demonstrates resilience, resourcefulness, and motivation for getting things done
Organized and process-driven
Approaches challenges as opportunities
Curious and challenges personal assumptions regularly
Welcomes feedback and open dialogue
Values team success over personal recognition
What You'll Be Doing:
Build and improve backend code primarily in TypeScript.
Set up and maintain metrics dashboards for production systems.
Update existing code to support new metrics and improve system observability.
Set up alerts and work closely with DevOps to optimize production systems.
Automate deployments and operational reporting to Slack.
Test systems in production, identify and troubleshoot issues, and fix bugs.
Help clean up and improve the existing codebase.
Write and maintain automated tests.
Improve and optimize deployment processes.
Implement code enhancements as new requirements emerge.
Skills, Requirements and Qualifications:
Bachelor’s degree or equivalent work experience.
2+ years of experience in a backend software engineering role.
Solid TypeScript development skills and strong backend software engineering fundamentals.
Good understanding of metrics, monitoring, and alerting, with the ability to debug and troubleshoot production systems.
Ability to write clean, maintainable, well-tested code and make reliable improvements to existing systems.
Nice to have:
Experience with Go.
Experience with Datadog, OpenObserve, and/or building Slack bots or integrations.
Familiarity with web scraping and browser automation, including Playwright.
Why Work With Us:
Opportunity. We are at the forefront of developing a web-scale crawler and knowledge graph that improves access to public web data and extends the value of AI to the people.
Culture. We're a lean team with a high bar. We come to work not to be comfortable, but to find out what we're capable of and to do work that matters. We're not calling for people who keep things moving. We're calling for people who make everyone around them better.
We prioritize low ego and high output. This is a fully remote team.
Compensation. You’ll receive a competitive salary, benefits and equity package.
Who We Are:
We build infrastructure that delivers massive amounts of web data to the companies training the world’s most powerful AI models.
We're the team that helps to power and support Grass, a bandwidth-sharing network that lets us operate a massive distributed crawler, giving us unique access to high-quality public web data at global scale. On top of that, we’ve built pipelines for ingesting, segmenting, and annotating billions of videos, transcripts, and audio files, powering dataset creation for frontier labs.
We’re lean, technical, and move fast. No red tape, no slow decision-making; just a team of builders pushing to expand what’s possible for open web data and AI.
The Role:
We are seeking a Data Engineer to support and improve large-scale data pipelines and infrastructure. You’ll work across data collection, processing, transformation, validation, and delivery, with a focus on scalability, reliability, and performance.
This is a hands-on role where you’ll work with distributed systems, large datasets, web scraping infrastructure, and production data workloads.
Please note: This role requires a work schedule that overlaps sufficiently with EST business hours to collaborate effectively with the team.
Who You Are:
Bachelor’s degree or equivalent work experience
Python (advanced) — strong grasp of async programming, multiprocessing, and writing production-grade code for long-running data jobs
Web scraping at scale — hands-on experience with high-volume scraping (proxies, rate limiting, anti-bot evasion). Experience with platform APIs and large media/metadata datasets (video platforms, social media)
Distributed data pipelines — experience designing and operating pipelines across many workers/servers using task queues (Celery, Kafka, RabbitMQ, or similar)
Data warehousing — practical experience with columnar/analytical warehouses; Databend, ClickHouse, or BigQuery strongly preferred; comfortable with complex analytical queries, partitioning strategies, cost-aware querying on cloud warehouses
Docker & Kubernetes — containerizing workloads, writing Helm charts/manifests, managing deployments, autoscaling scraping/processing workloads
Linux & bare-metal ops — comfortable managing services on Linux servers, debugging performance issues (disk I/O, network, memory) without managed-cloud abstractions
CI/CD for data workflows (GitHub Actions, ArgoCD)
Writing Scalable API
What You'll Be Doing:
Maintain, optimize, and troubleshoot database queries and related data systems to support efficient data access, processing, and reliability.
Assist in creating, maintaining, and improving data pipelines used to collect, process, transform, validate, and deliver large-scale datasets.
Support web scraping and data collection initiatives, including developing, testing, and maintaining scripts or tools used to gather publicly available data in accordance with Company requirements.
Monitor and troubleshoot data pipeline issues, identify data quality concerns, and help implement timely fixes to maintain data accuracy and operational continuity.
Document engineering work, including database queries, pipeline processes, scraping workflows, technical decisions, issues encountered, and resolutions implemented.
Participate in research and development projects to improve the Company’s data products and workflows.
Why Work With Us:
Opportunity. We are at the forefront of developing a web-scale crawler and knowledge graph that improves access to public web data and extends the value of AI to the people.
Culture. We're a lean team with a high bar. We come to work not to be comfortable, but to find out what we're capable of and to do work that matters. We're not calling for people who keep things moving. We're calling for people who make everyone around them better.
We prioritize low ego and high output. This is a fully remote team.
Compensation. You’ll receive a competitive salary, benefits and equity package.