📄️ Run via Ilum UI
Learn how to deploy and manage standard Jar or Python Apache Spark jobs on Kubernetes using the Ilum UI. A powerful, user-friendly alternative to spark-submit.
📄️ Run via Ilum API
Learn how to programmatically submit, manage, and monitor Apache Spark jobs on Kubernetes using the Ilum REST API. Ideal for CI/CD pipelines and automation.
📄️ Run via Ilum Spark Submit
Learn how to run Apache Spark jobs on Kubernetes using the familiar spark-submit command with Ilum. Automate configuration, monitoring, and storage access.
📄️ Run via Spark Connect
আইলাম ক্লাস্টারে অ্যাপাচি স্পার্ক কানেক্ট কনফিগার করা এবং সংযোগ করা। স্পার্ক মাইক্রোসার্ভিসেসের পরিচিতি।
📄️ Run in Different Namespaces
A complete guide on configuring Ilum to execute Apache Spark jobs across different Kubernetes namespaces for better multi-tenancy and security.
📄️ Run dbt Job
Configure dbt-spark with Thrift Server or Spark Connect on Kubernetes. Step-by-step guide for data transformation pipelines.
📄️ Orchestrate dbt with Airflow
Learn how to automate dbt pipelines using Apache Airflow. Build medallion architectures with auto-generated DAGs on Kubernetes.
📄️ Schedule Jobs
Automate Apache Spark job execution on Kubernetes. Configure CRON schedules for ETL pipelines, Python scripts, and JARs using Ilum.