K
Posted 21 hours ago
Sr. AI Data Pipeline Specialist
KraftonSr. AI Data Pipeline Specialist
Requirements
7+ years data engineering experience, Proficiency in Python and SQL, Cloud environment expertise (AWS, GCP), Experience with Airflow, Spark, or Kafka, Deep understanding of RDBMS, NoSQL, and DW
Skills
PythonSQLAWSAirflowSparkKafkaLLM
About the role
Responsibilities
- Design and research data pipeline architectures optimized for AI (LLM, RAG systems)
- Develop preprocessing and processing methodologies for large-scale unstructured data (Wiki, Slack, documents)
- Establish data quality analysis, monitoring metrics, and governance standards
- Research and propose Modern Data Stack technologies and implementation strategies
- Design and implement ETL/ELT pipelines and Data Warehouse/Data Lake architectures
- Design automation for pipeline stability and establish incident response systems
Requirements
- 7+ years of professional experience in data engineering
- Proficiency in Python and SQL for data processing and pipeline architecture design
- Deep understanding of cloud environments (AWS, GCP)
- Professional expertise in distributed processing and orchestration tools (Airflow, Spark, Kafka)
- Deep understanding of database structures (RDBMS, NoSQL, DW)
- Ability to travel overseas if required
Preferred Qualifications
- Experience with data preprocessing for LLM/RAG and Vector DBs (Milvus, Pinecone)
- Experience collecting and parsing large-scale unstructured data from Confluence or Slack
- Experience building new data platforms from scratch (Zero to One)
- Strong interest in AI technology trends and the Modern Data Stack
About the Company
Krafton is a global gaming company dedicated to creating unforgettable worlds for fans through bold imagination and breakthrough technology.
ScoutJobs Agent
Get matches like this delivered daily
Sign up free — we'll pull jobs that fit your CV from across the web and rank them for you.
Get started — it's freeSr. AI Data Pipeline Specialist
Krafton · Seoul
