Data Engineer (Lambda)
Upload My Resume
Drop here or click to browse · PDF, DOCX, DOC, RTF, TXT
Requirements
• Strong SQL skills with columnar databases (ClickHouse, Druid, BigQuery, etc.). • Hands-on streaming frameworks experience (Flink, Kafka, or similar). • Solid Python skills for data engineering and backend services. • Proven track record of delivering pipelines and features to production on schedule. • Strong focus on automation, reliability, maintainability, and documentation. • Startup mindset: keep balance between speed and quality. • Experience operating ClickHouse at scale (performance tuning, partitioning, materialized views) • Experience with CI/CD and automated testing for data pipelines (e.g. GitHub Actions, dbt) • Knowledge of multi-chain ecosystems (EVM & non-EVM) • Familiarity with blockchain/crypto data structures (transactions, logs, ABI decoding). • Contributions to open-source or blockchain data infrastructure projects • At P2P.org http://P2P.org we have a team of experts with their own unique approach and ownership culture. Together we gain experience and make dreams come true! • Full-time contractor (Indefinite-term Consultancy Agreement) • Competitive salary level in $ (we can also pay in crypto) • Paid vacation and sick leave • Well-being program • Mental Health care program • Compensation for education, including foreign language & professional growth courses • Equipment & co-working reimbursement program • Overseas conferences, community immersion • P2P.org http://P2P.org is committed to providing equal opportunities. All applicants will be considered without regard to race, color, national origin, religion, sex, sexual orientation, gender identity, veteran status, or disability.
Responsibilities
• Design, maintain, and scale streaming ETL pipelines for blockchain data. • Build and optimize ClickHouse data models and materialized views for high-performance analytics. • Develop and maintain data exporters using orchestration tools. • Implement data transformations and decoding logic. • Combine multiple data sources — indexers and Kafka topics from third parties — to aggregate them into tables for our API. • Establish and improve testing, monitoring, automation, and migration processes for pipelines. • Ensure timely delivery of new data features in alignment with product goals. • Create automation tools for data analyst inputs, such as a dictionary, to keep them up to date. • Streaming & ETL: Managed Flink-based pipelines (real-time event & transaction processing), Apache Kafka • Data Warehouse: ClickHouse (Cloud) • Workflow orchestration: Airflow • Programming: Python (data processing, services, automation) • Domain: Multi-chain crypto data (EVM & non-EVM ecosystems) • 4+ years in Data Engineering (ETL/ELT, data pipelines, streaming systems).
Benefits
• Equity in P2P.org and Lambda platform; details on the equity structure are provided but no specific compensation is mentioned for this benefit alone. • Perks like free food (lunch) mentioned but no other perks explicitly listed within the job posting text itself.