GFK Nurago

GfK — AWS/DevOps Engineer (Contract)

GfK — AWS/DevOps Engineer (Contract)

About the company

GfKGfK (now part of NIQ) is a global market research and consumer intelligence company, measuring consumer behaviour, market trends, and panel data. The company runs a global suite of panelist data aggregation and tracking tools, which were migrated from legacy infrastructure to AWS during this engagement.

As an AWS/DevOps Engineer on a remote contract at GfK, my main responsibility was to support and migrate a global suite of panelist data aggregation tracking tools from legacy infrastructure to Amazon Web Services (AWS). The work included building scalable infrastructure, Big Data solutions with Elasticsearch, Kinesis, Firehose, and EMR, and operations with monitoring and admin tools.

Role Location Period
AWS/DevOps Engineer Berlin, Germany Jul 2017 – Oct 2019

Key responsibilities and achievements

  • AWS infrastructure — Used Elastic Beanstalk, S3, RDS, ELB, Auto Scaling, CloudFront, and Route53 to build scalable, resilient hosting for the panelist tracking tools.
  • IaC — Terraform and CloudFormation for provisioning and managing infrastructure.
  • Big Data — Elasticsearch, AWS Kinesis, Firehose, EMR, and Hadoop for large-scale data ingestion and analysis.
  • Operations — Munin, Icinga, Graphite, and New Relic for monitoring and performance.
  • Automation — Bash and Python scripts and AWS Lambda to extend and automate the tracking tools.
  • Data & config — JSON for data and configuration.
  • Collaboration — TeamCity, Bamboo, JIRA, Confluence, and Stash for build, project management, and collaboration.

Supporting and migrating the global panelist data aggregation tracking suite to AWS, combining resilient infrastructure, Big Data pipelines, and strong operational visibility.

Technologies

Category Technologies
AWS Elastic Beanstalk, S3, RDS, ELB, Auto Scaling, CloudFront, Route53, Lambda
IaC Terraform, CloudFormation
Big Data Elasticsearch, Kinesis, Firehose, EMR, Hadoop
Monitoring Munin, Icinga, Graphite, New Relic
Scripting & automation Bash, Python, JSON
Admin & CI TeamCity, Bamboo, JIRA, Confluence, Stash

References

    Posts

    References

      Posts