Senior Data Engineer
Deadline: 22 September 2019
Employment term: Permanent
Category: Software development
Job type: Full time
DISQO is for constant advances in technology to create an exciting new world for those who understand the value of data. You, as a data engineer, will be involved in the design and development of cost-efficient and reliable, fault tolerant pipelines for data ingestion and retrieval, as well as in design, implementation, and maintenance of data lake and data warehouse. You are to join the team to support the existing processes that grow rapidly and cooperate with the data science team to build the right solutions for them. You are to be collaborative and be a strong team member keeping the team success first in line and be a self-starter with the willingness to take the supervisor’s responsibility when the latter is missing.
Writing Spark applications using Scala
Scripting and writing Airflow DAGs with Python
Interacting with Redshift (Spectrum) and Athena using SQL, Postgres or MySQL
Building ETL jobs in SQL
Leveraging AWS services to build modern cloud based data solutions
Experience with Scala, either experience with Java to switch to Scala later
Experience with Python or Java
Experience with Spark
Experience with various data formats (any of: Parquet, Avro, ORC, ProtoBuf)
Experience with Hadoop and AWS data ecosystem (any of: Redshift, EMR, Glue/Hive, Athena/Presto, Zeppelin, etc.)
Experience with ETL/ELT tools and concepts, data modeling, SQL, query performance optimization
Experience with building stream processing applications using Kinesis or Kafka
AWS certification is a plus
DevOps experience is a plus
Ability to work with remote team
- Advanced written and verbal English communication skills
Required candidate level: Senior
Share this job via your favorite social media channel.
You can apply for this job just by following Application procedure.
Please, follow the link to apply for this role: https://www.disqo.com/careers/career/?id=4280984002?gh_jid=4280984002
DISQO is the leading provider of first-party opinion and behavior data to the world's largest market research agencies, analytics companies, and brands included in the Fortune 500 list.
We operate one of the world's largest true consumer insights panels. Our members actively participate in over 10 million surveys and share billions of deep cross-site & multi-channel behavioral data points with us every year. Founded in LA, DISQO has opened a new branch in Armenia involving the local innovative talent in large-scale international projects and initiatives.
We believe that quality data comes directly from people. Only by engaging qualified people are we able to harness the accurate and complete intelligence which drive the most important decisions for our clients. We are building best-in-breed software to help all knowledge workers make better products, improve consumer experience and eliminate waste.
Find more about DISQO at www.disqo.com.
Perks of DISQO
We enjoy a flexible work schedule and personal time-off policy. We focus on deliverables and believe in supporting a culture of trust and responsibility.
We are dedicated to helping our employees live healthier and longer. We cover 100% of the cost of premiums for employees for medical, dental and vision insurance.
We believe that fun is an inextricable part of every activity and besides the casual work environment we enjoy ping pong tournaments, video game nights, regular happy hours, seriously good coffee, great music, and more.
Our kitchen is fully stocked to ensure we are fueled to perform our best. To mix it up, we have catered lunches from various local restaurants.
Flex your skills and learn from your peers. We are made up of talented, driven and ambitious people who practice curiosity and collaboration.
American DISQO in Armenia
American DISQO IT company, which has recently attracted USD 13.5 million investment, announced opening of its branch in Armenia.
$13.5 Mln Funding, 30 Vacancies: DISQO - American Tech Company Opens New Branch in Armenia
Yerevan - October 2, 2018 - DISQO, a fast growing tech company from the US, announced $13.5 mln in funding and is establishing a new branch in Armenia. The company provides the highest quality first-hand consumer data to the world’s largest market research and analytics companies. At this new stage of development, the Armenian founders are tapping into Armenia’s innovative potential...
Address: 16 Halabyan St., Yerevan