HIVE-29411: Provide docker image for LLAP by abstractdog · Pull Request #6390 · apache/hive

abstractdog · 2026-03-25T14:06:25Z

What changes were proposed in this pull request?

Implemented an LLAP Docker image with all required files and configurations. Also added Docker Compose, incorporating two daemons to demonstrate multiple daemons working together (e.g., shuffle).

Why are the changes needed?

One step towards a fully-distributed Dockerized Hive setup.

Does this PR introduce any user-facing change?

No.

How was this patch tested?

Start the HS2 + HMS + 2 LLAP setup:

cd packaging/src/docker

# cleanup previous containers and images if any
docker-compose --profile llap -f docker-compose.yml down --rmi local

# set the path to the postgres driver jar on the host machine
export POSTGRES_LOCAL_PATH=~/.m2/repository/org/postgresql/postgresql/42.7.3/postgresql-42.7.3.jar

# build all needed images 
./build.sh -hive 4.2.0 -hadoop 3.4.1 -tez 0.10.5

# start everything and follow logs
docker compose --profile llap -f docker-compose.yml up -d
docker compose --profile llap -f docker-compose.yml logs -f

Try it with beeline and see logs:

beeline -u 'jdbc:hive2://localhost:10000/' -n $USER
DROP table IF EXISTS iceberg_table; CREATE TABLE iceberg_table (id BIGINT) STORED BY iceberg; INSERT INTO iceberg_table VALUES(1);

Check LLAP daemons' web UI:
http://localhost:15001/
http://localhost:15002/

Proof that tasks went to different daemons:

llapdaemon2  | 2026-03-26T09:05:00,843  INFO [TezTR-852925_1_2_1_0_0 (1774515852925_0001_2_01_000000_0)] exec.SerializationUtilities: Deserializing ReduceWork using kryo

llapdaemon1  | 2026-03-26T09:05:00,637  INFO [TezTR-852925_1_2_0_0_0 (1774515852925_0001_2_00_000000_0)] exec.SerializationUtilities: Deserializing MapWork using kryo

Aggarwal-Raghav · 2026-03-25T15:29:35Z

packaging/src/docker/docker-compose-llap.yml

+# limitations under the License.
+services:
+  zookeeper:
+    image: zookeeper:3.9


Better to use same zookeeper version as in pom i.e. 3.8.4

Aggarwal-Raghav · 2026-03-25T16:14:45Z

It's working, used the following url for faster download.

export HADOOP_URL=https://dlcdn.apache.org/hadoop/common/hadoop-3.4.1/hadoop-3.4.1.tar.gz
export TEZ_URL=https://dlcdn.apache.org/tez/0.10.5/apache-tez-0.10.5-bin.tar.gz
export HIVE_URL=https://dlcdn.apache.org/hive/hive-4.2.0/apache-hive-4.2.0-bin.tar.gz
export POSTGRES_LOCAL_PATH=~/.m2/repository/org/postgresql/postgresql/42.7.3/postgresql-42.7.3.jar
export HIVE_VERSION=4.2.0

Aggarwal-Raghav · 2026-03-25T16:18:46Z

During docker compose its giving warn. I think default values can be provided for these vars HIVE_WAREHOUSE_PATH and DEFAULT_FS

WARN[0000] The "S3_ENDPOINT_URL" variable is not set. Defaulting to a blank string.
WARN[0000] The "AWS_SECRET_ACCESS_KEY" variable is not set. Defaulting to a blank string.
WARN[0000] The "AWS_ACCESS_KEY_ID" variable is not set. Defaulting to a blank string.
WARN[0000] The "DEFAULT_FS" variable is not set. Defaulting to a blank string.
WARN[0000] The "HIVE_WAREHOUSE_PATH" variable is not set. Defaulting to a blank string.
WARN[0000] The "S3_ENDPOINT_URL" variable is not set. Defaulting to a blank string.
WARN[0000] The "AWS_ACCESS_KEY_ID" variable is not set. Defaulting to a blank string.
WARN[0000] The "AWS_SECRET_ACCESS_KEY" variable is not set. Defaulting to a blank string.

Aggarwal-Raghav · 2026-03-25T16:44:49Z

packaging/src/docker/README.md

+  -p 15004:15004 \
+  -p 15551:15551 \
+  -p 15002:15002 \
+  -e HADOOP_CONF_DIR=/etc/hadoop \


the conf dir should be ?

/opt/hadoop/etc/hadoop/ /opt/hive/conf/

this whole section doesn't make sense anymore, I mean, to start an LLAP daemon alone, removing this and let the users rely on the docker-compose

Aggarwal-Raghav · 2026-03-25T17:09:32Z

packaging/src/docker/Dockerfile-llap

+      --exclude="*tests.jar" \
+      --exclude="*/webapps" \
+      -f /opt/hadoop-$HADOOP_VERSION.tar.gz \
+      -C /opt/ && \


nit: maybe rm -rf the tarball. i know it won't help in docker image size because of multi-stage build.

Aggarwal-Raghav · 2026-03-25T17:13:08Z

packaging/src/docker/Dockerfile-llap

+      -f /opt/apache-tez-$TEZ_VERSION-bin.tar.gz \
+      -C /opt
+
+FROM eclipse-temurin:21.0.3_9-jdk-ubi9-minimal AS run


nit: Maybe use eclipse-temurin:21-jdk-ubi9-minimal its a rolling tag pointing to JDK21 latest

Aggarwal-Raghav · 2026-03-25T17:18:14Z

packaging/src/docker/docker-compose-llap.yml

+# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+# See the License for the specific language governing permissions and
+# limitations under the License.
+services:


nit: name: llap-cluster can be added. currently it coming as docker in docker desktop

finally, this has been moved to the original cluster and now has the name "hive-cluster"

Aggarwal-Raghav · 2026-03-25T17:23:59Z

packaging/src/docker/entrypoint-llap.sh

+
+mkdir -p "${LLAP_DAEMON_LOG_DIR}" "${LLAP_DAEMON_TMP_DIR}" "${LOCAL_DIRS}"
+
+cd "${HIVE_HOME}"


do we need this cd "${HIVE_HOME}" as WORKDIR $HIVE_HOME is set in Dockerfile-llap?

abstractdog · 2026-03-25T20:47:08Z

thanks @Aggarwal-Raghav for your comments so far, addressed them in 3a31f13

deniskuzZ · 2026-03-26T10:14:00Z

instead of docker-compose-llap.yml could we add llap as param?

docker compose --profile llap up -d

services:
  llapdaemon1:
    image: apache/hive-llap:${HIVE_VERSION}
    container_name: llapdaemon1
    profiles:
      - llap

abstractdog · 2026-03-26T11:14:03Z

instead of docker-compose-llap.yml could we add llap as param?

docker compose --profile llap up -d

services:
  llapdaemon1:
    image: apache/hive-llap:${HIVE_VERSION}
    container_name: llapdaemon1
    profiles:
      - llap

sounds good, let me check

abstractdog · 2026-03-26T11:53:49Z

instead of docker-compose-llap.yml could we add llap as param?
docker compose --profile llap up -d

services:
  llapdaemon1:
    image: apache/hive-llap:${HIVE_VERSION}
    container_name: llapdaemon1
    profiles:
      - llap
sounds good, let me check

@deniskuzZ: seems to work a115774
a separate hiveserver2 was needed because of config, I don't think it's a problem, a fair trade-off for different setups

abstractdog · 2026-03-27T07:38:35Z

one more thing to check: let me try if a single hive image is suitable here with a different llap entrypoint, hence we won't need to maintain and deploy different images like "hive" and "hive-llap"

abstractdog · 2026-03-27T08:03:28Z

one more thing to check: let me try if a single hive image is suitable here with a different llap entrypoint, hence we won't need to maintain and deploy different images like "hive" and "hive-llap"

works like a charm with 0860209

sonarqubecloud · 2026-03-28T12:04:47Z

Quality Gate passed

Issues
0 New issues
0 Accepted issues

Measures
0 Security Hotspots
0.0% Coverage on New Code
0.0% Duplication on New Code

See analysis details on SonarQube Cloud

Aggarwal-Raghav · 2026-03-28T16:45:44Z

packaging/src/docker/entrypoint.sh

+  export LLAP_DAEMON_OPTS
+
+  if [[ -n "${LLAP_EXTRA_OPTS:-}" ]]; then
+    export LLAP_DAEMON_OPTS="${LLAP_DAEMON_OPTS:-} ${LLAP_EXTRA_OPTS}"


We can remove export from L119 export LLAP_DAEMON_OPTS and move L116 which just exporting after this 2nd if stmt?

for opt in "${JAVA_ADD_OPENS[@]}"; do if [[ " ${LLAP_DAEMON_OPTS:-} " != *" ${opt} "* ]]; then LLAP_DAEMON_OPTS="${LLAP_DAEMON_OPTS:-} ${opt}" fi done if [[ -n "${LLAP_EXTRA_OPTS:-}" ]]; then LLAP_DAEMON_OPTS="${LLAP_DAEMON_OPTS:-} ${LLAP_EXTRA_OPTS}" fi export LLAP_DAEMON_OPTS

Aggarwal-Raghav · 2026-03-28T16:46:38Z

packaging/src/docker/entrypoint.sh

+  : "${LLAP_SERVICE_HOSTS:=@llap0}"
+  : "${LLAP_MEMORY_MB:=1024}"
+  : "${LLAP_EXECUTORS:=1}"
+  export HIVE_ZOOKEEPER_QUORUM


nit, the export can be combined as done for L86-94:

export HIVE_ZOOKEEPER_QUORUM="${HIVE_ZOOKEEPER_QUORUM:-zookeeper:2181}" export LLAP_SERVICE_HOSTS="${LLAP_SERVICE_HOSTS:-@llap0}" export LLAP_MEMORY_MB="${LLAP_MEMORY_MB:-1024}" export LLAP_EXECUTORS="${LLAP_EXECUTORS:-1}"

Aggarwal-Raghav · 2026-03-28T16:48:20Z

In the description of the JIRA, beeline -u 'jdbc:hive2://localhost:10000/' -n $USER should point to now localhost:10001 port as that is hs2 for llap

Aggarwal-Raghav · 2026-03-28T16:50:53Z

packaging/src/docker/docker-compose.yml

    environment:
+      USER: hive
      HADOOP_CLASSPATH: /opt/hadoop/share/hadoop/tools/lib/*
      HIVE_SERVER2_THRIFT_PORT: 10000


HIVE_SERVER2_WEB_PORT: 10002 should be defined here for keeping similarity with LLAP profile?
It's automatically picking localhost:10002 and working but better to define it.

Aggarwal-Raghav · 2026-03-28T17:33:17Z

@abstractdog , I'm seeing 1 error (metrics related) when I restart beeline session, attaching screenshot and logs
Steps:

docker compose --profile llap -f docker-compose.yml up -d
docker exec -it hiveserver2-llap bash
beeline -u 'jdbc:hive2://hiveserver2-llap:10001/'
DROP table IF EXISTS iceberg_table; CREATE TABLE iceberg_table (id BIGINT) STORED BY iceberg; INSERT INTO iceberg_table VALUES(1); 
✅
!q
beeline -u 'jdbc:hive2://hiveserver2-llap:10001/'
DROP table IF EXISTS iceberg_table; CREATE TABLE iceberg_table (id BIGINT) STORED BY iceberg; INSERT INTO iceberg_table VALUES(1);
❌

logs.txt

deniskuzZ · 2026-03-30T17:26:37Z

⠙ hiveserver2-llap Pulling
⠸ hiveserver2 Pulling

is that expected?

Aggarwal-Raghav · 2026-03-30T17:29:12Z

⠙ hiveserver2-llap Pulling ⠸ hiveserver2 Pulling

is that expected?

At what phase you faced that? I didn't, Please ensure you have

export HIVE_VERSION=4.2.0
./build.sh -hive 4.2.0 -hadoop 3.4.1 -tez 0.10.5

deniskuzZ · 2026-03-30T17:35:05Z

⠙ hiveserver2-llap Pulling ⠸ hiveserver2 Pulling
is that expected?

At what phase you faced that? Please ensure you have
export HIVE_VERSION=4.2.0
./build.sh -hive 4.2.0 -hadoop 3.4.1 -tez 0.10.5

docker compose, are we starting 2 hs2?

526347bb9f27   apache/hive:4.2.0   "sh -c /entrypoint.sh"   40 seconds ago   Up 39 seconds                  0.0.0.0:10000->10000/tcp, 9083/tcp, 0.0.0.0:10002->10002/tcp                         hiveserver2
78b9cddef5cc   apache/hive:4.2.0   "sh -c /entrypoint.sh"   40 seconds ago   Up 39 seconds                  9083/tcp, 10000/tcp, 0.0.0.0:10001->10001/tcp, 10002/tcp, 0.0.0.0:10003->10003/tcp   hiveserver2-llap

i think we should move regular hs2 under tez profile

deniskuzZ · 2026-03-30T17:40:26Z

packaging/src/docker/docker-compose.yml

+    networks:
+      - hive
+
+  hiveserver2-llap:


could we merge the definitions?

hiveserver2: image: apache/hive:${HIVE_VERSION} container_name: hiveserver2 hostname: hiveserver2 depends_on: - metastore restart: unless-stopped environment: USER: hive HADOOP_CLASSPATH: /opt/hadoop/share/hadoop/tools/lib/* HIVE_SERVER2_THRIFT_PORT: 10000 HIVE_SCRATCH_DIR: /opt/hive/scratch HIVE_QUERY_RESULTS_CACHE_DIRECTORY: /opt/hive/scratch/_resultscache_ SERVICE_NAME: 'hiveserver2' IS_RESUME: 'true' # Base SERVICE_OPTS without LLAP SERVICE_OPTS: >- -Xmx1G -Dhive.metastore.uris=thrift://metastore:9083 -Dhive.execution.engine=tez S3_ENDPOINT_URL: "${S3_ENDPOINT_URL}" AWS_ACCESS_KEY_ID: "${AWS_ACCESS_KEY_ID}" AWS_SECRET_ACCESS_KEY: "${AWS_SECRET_ACCESS_KEY}" ports: - "10000:10000" - "10002:10002" volumes: - warehouse:/opt/hive/data/warehouse - scratch:/opt/hive/scratch - ./jars:/tmp/ext-jars:ro networks: - hive # Add profile-specific override for LLAP profiles: [default, llap] hiveserver2-llap-env: profiles: [llap] environment: SERVICE_OPTS: >- -Xmx1G -Dhive.metastore.uris=thrift://metastore:9083 -Dhive.execution.engine=tez -Dhive.execution.mode=llap -Dhive.llap.execution.mode=all -Dhive.zookeeper.quorum=zookeeper:2181 -Dhive.llap.daemon.service.hosts=@llap0

zookeeper: profiles: [llap] llapdaemon1: profiles: [llap] llapdaemon2: profiles: [llap]

Aggarwal-Raghav · 2026-03-30T17:52:56Z

⠙ hiveserver2-llap Pulling ⠸ hiveserver2 Pulling
is that expected?

At what phase you faced that? Please ensure you have
export HIVE_VERSION=4.2.0
./build.sh -hive 4.2.0 -hadoop 3.4.1 -tez 0.10.5

docker compose, are we starting 2 hs2?

526347bb9f27   apache/hive:4.2.0   "sh -c /entrypoint.sh"   40 seconds ago   Up 39 seconds                  0.0.0.0:10000->10000/tcp, 9083/tcp, 0.0.0.0:10002->10002/tcp                         hiveserver2
78b9cddef5cc   apache/hive:4.2.0   "sh -c /entrypoint.sh"   40 seconds ago   Up 39 seconds                  9083/tcp, 10000/tcp, 0.0.0.0:10001->10001/tcp, 10002/tcp, 0.0.0.0:10003->10003/tcp   hiveserver2-llap

i think we should move regular hs2 under tez profile

Maybe @abstractdog can give proper reply but my understanding is that before llap profile was introduced, a regular hs2 was running, and after llap profile, a new hiveserver2-llap is introduced. If we move the regular hs2 under tez profile then we are changing the older behaviour of how the docker command was used by users isn't it?
Also, i can't find any tez profile in docker-compose.yml? you mean introduce a new one?

asf-ci-hive added the tests pending label Mar 25, 2026

Aggarwal-Raghav reviewed Mar 25, 2026

View reviewed changes

asf-ci-hive added tests passed and removed tests pending labels Mar 25, 2026

Aggarwal-Raghav reviewed Mar 25, 2026

View reviewed changes

abstractdog force-pushed the HIVE-29411 branch from c53239a to 3a31f13 Compare March 25, 2026 20:46

asf-ci-hive added tests pending and removed tests passed labels Mar 25, 2026

asf-ci-hive added tests passed and removed tests pending labels Mar 25, 2026

abstractdog force-pushed the HIVE-29411 branch from 3a31f13 to 90a1a97 Compare March 26, 2026 09:07

asf-ci-hive added tests pending and removed tests passed labels Mar 26, 2026

asf-ci-hive added tests unstable and removed tests pending labels Mar 26, 2026

asf-ci-hive added tests pending tests passed and removed tests unstable tests pending labels Mar 26, 2026

abstractdog force-pushed the HIVE-29411 branch from 7d8ffdb to 0860209 Compare March 27, 2026 08:03

asf-ci-hive added tests failed and removed tests pending labels Mar 27, 2026

abstractdog added 5 commits March 27, 2026 10:04

HIVE-29411: Provide docker image for LLAP

1dc9cab

PR comments

674a1fe

2 LLAP daemons

6b9c1a5

single docker-compose with LLAP profile

a07a85a

single hive image

1ccd392

abstractdog force-pushed the HIVE-29411 branch from 0860209 to 1ccd392 Compare March 27, 2026 09:05

asf-ci-hive added tests pending tests passed and removed tests failed tests pending labels Mar 27, 2026

separate hiveserver2 with separate ports

93c30ab

asf-ci-hive added tests pending and removed tests passed labels Mar 28, 2026

asf-ci-hive added tests passed and removed tests pending labels Mar 28, 2026

Aggarwal-Raghav reviewed Mar 28, 2026

View reviewed changes

deniskuzZ reviewed Mar 30, 2026

View reviewed changes


		mkdir -p "${LLAP_DAEMON_LOG_DIR}" "${LLAP_DAEMON_TMP_DIR}" "${LOCAL_DIRS}"

		cd "${HIVE_HOME}"

Conversation

abstractdog commented Mar 25, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

What changes were proposed in this pull request?

Why are the changes needed?

Does this PR introduce any user-facing change?

How was this patch tested?

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Aggarwal-Raghav commented Mar 25, 2026

Uh oh!

Aggarwal-Raghav commented Mar 25, 2026

Uh oh!

Aggarwal-Raghav Mar 25, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

abstractdog commented Mar 25, 2026

Uh oh!

deniskuzZ commented Mar 26, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

abstractdog commented Mar 26, 2026

Uh oh!

abstractdog commented Mar 26, 2026

Uh oh!

abstractdog commented Mar 27, 2026

Uh oh!

abstractdog commented Mar 27, 2026

Uh oh!

sonarqubecloud bot commented Mar 28, 2026

Quality Gate passed

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Aggarwal-Raghav commented Mar 28, 2026

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Aggarwal-Raghav commented Mar 28, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

deniskuzZ commented Mar 30, 2026

Uh oh!

Aggarwal-Raghav commented Mar 30, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

deniskuzZ commented Mar 30, 2026

Uh oh!

deniskuzZ Mar 30, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Aggarwal-Raghav commented Mar 30, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants

abstractdog commented Mar 25, 2026 •

edited

Loading

Aggarwal-Raghav Mar 25, 2026 •

edited

Loading

deniskuzZ commented Mar 26, 2026 •

edited

Loading

Aggarwal-Raghav commented Mar 28, 2026 •

edited

Loading

Aggarwal-Raghav commented Mar 30, 2026 •

edited

Loading

deniskuzZ Mar 30, 2026 •

edited

Loading