galactica.conf

Number of requested nodes in the cluster. See install-indexima-engine for details.

nodes.connect.min-nodes

Minimum number of nodes to start the cluster. See install-indexima-engine for details.

warehouse

required

home/indexima/warehouse

Absolute path for storage of HyperIndex and Data Spaces.
Please see detailed configuration of shared storage.

No

cores

required

Number of CPU cores used by Indexima Data Engine. Indexima only supports an equal number of cores used per node. If you have nodes with a different number of cores between each other, you must set this parameter to the lowest common denominator.
example: cores = 8

No

loaders

queries

required

Added to the name of the .zip file generated during a Diagnosis

partitions

required

Number of shards (a type of horizontal partitions) across potentially multiple instances of the schema.

It is highly recommended to set partitions according to the formula: partitions = cores * number of nodes.

You can oversize it if you want to anticipate a cluster size change.

You can not undersize it.

If you change the number of partitions, all your tables must be dropped and recreated, and all data reloaded.
example: For a 4 nodes cluster with 8 cores per node: partitions = 32   

No

Defines the maximum size in Mb of files generated during an export.

No

When true, Indexima creates one file per column to take advantage of the Indexima K-Store technology. So when using local/shared file systems or cloud file-systems such as S3, this parameter must be set to true.

When false, Indexima forces K-Store to store all columns in a single file to limit the number of open files. This is used when the Indexima warehouse is located on an HDFS file system.

No

false

false

Amazon S3 directory where files are stored for S3 compatible FS

node.port

Port used by the Indexima Galactica engine to communicate with the other nodes of the Indexima Cluster.

Note: Indexima also use the 'port +1' for internal communication. Eg if node.port is 19999, the port 20000 is also used.

No

webui.port

Port used by the Indexima Monitor Console. This webserver aggregates logs, queries history, and hosts Indexima Analyzer, among other features.
For more information about the Indexima Monitor, refer to the Indexima Monitor Documentation

No

webui.ssl.enable

When true, The Indexima Monitor Console uses a secured SSL HTTPS protocol to connect.

webui.ssl.keystore.location and webui.ssl.keystore.password must be previously set up to enable this feature.

When false, the standard HTTP protocol is used.

No

webui.ssl.keystore.location

Specify the location of the SSL certificates Keystore to secure the Indexima Monitor console access with HTTPS
example: webui.ssl.keystore.location = /etc/indexima/keystore/mycluster.indexima.co.keystore

No

webui.ssl.keystore.password

Define the password associated with the Indexima Keystore. 

No

EvdbpGMCWPzpSzgkjTqq9SjM

heartbeat

Time in milliseconds for a full round-trip heartbeat packet between the Indexima master and each worker node. The default value is 5 minutes. 

No

jdbc.timeout.seconds

No

jdbc.load.fetch.size

Yes

jdbc.query.timeout.seconds

Timeout for statement JDBC execution in seconds

Yes

jdbc.create.field.restriction

true

When set to true, Indexima replaces some characters on the fly to avoid wrong interpretation of incoming data.

Character substitution chart

Yes

log.dir

Path to the folder where the indexima logs are written

No

index.memory.max_size defines the maximum size (in Mb) of each index, per node.

This parameter limits the size of an HyperIndex to prevent running out of memory if the cardinality of the selected index is too high.

Yes

Set the maximum size of a dataspace (table) per node. The size is in Mb. This parameter prevents running out of memory when using multiple large tables.

Yes

Max active partition allowed for queries on a big index

query.max

Yes

Timeout in milliseconds of query execution. If the query lasts more than the timeout time, the system will stop the query with the error Timeout

False allows to respond to the show table sent by Cognos which does not contain the name of the schema

Define a certain amount of RAM in MB allocated to cache Hive 2 queries addressed by Indexima Data Hub for better performance

Yes

Define the threshold upon a query result would be put into the cache

Yes

Coefficient of max heap memory used for the Hyperindexes

No

impersonation

When impersonation = true, the Indexima account is used to grant access to shared storage on each node of the Indexima cluster

No

webui.authenticate

when webui.authenticate = false, there is no access control for the Indexima MONITOR located at <Your_URL>:9999

when webui.authenticate = true and when hive-site.xml contains the address and access rules of an LDAP server, Indexima MONITOR access is granted only if the specified user at login time of Indexima ADMIN console is authenticated by the LDAP service.

session.users

session.passwords

List of passwords for users in session.user. Passwords are attributed to the user in the corresponding list index
example: session.passwords =pass1, pass2, pass3

In the example above, user1 has password "pass1", user2 has password "pass2", and user3 has password "pass3".

privilege.driver.name

privilege.driver.property.servicetype

privilege.driver.property.appid

node.ssl.enable

node.ssl.keystore.location

node.ssl.keystore.password

analyzer.hits

Let you define the default required hits when you enter the Analyzer page.

example: analyzer.hits = 5

UI

analyzer.days

Let you define the default number of days when you enter the Analyzer page.

example: analyzer.days = 10

analyzer.cardinality

Let you define the default cardinality when you enter the Analyzer page.

example: analyzer.cardinality = 6

sampling.external.max

sampling.internal.max

analyzer.evaluation.cardinality.small

analyzer.evaluation.cardinality.medium

analyzer.evaluation.cardinality.big

Default policy used to merge indexes (COEF, MAX_INDEX).

• COEF: The user can use a coefficient between 0 & 100 in the analyzer in order to get a few or plenty of hyperindexes suggestions
• MAX_INDEX: a maximum of analyser.default-max-expected-indexes will be suggested

yarn.resourcemanager.hostname

Hostname of the Yarn Resource Manager to call in order to create the Indexima Yarn Application

example: yarn.resourcemanager.hostname = localhost

No

yarn.memory.mb

Allocates memory (in mb) to run the Indexima data engine. This value must be greater than java heap (GALACTICA_MEM) + 20%

example: yarn.memory = 40000 (40 GB)

yarn.memory.master.mb

Memory size (in mb) of the master container. This value must be the lower possible but greater than the value set by Hadoop or an error is fired by YARN.

example: yarn.memory.master = 128

yarn.dir

hdfs://localhost:8020/user/` + System.getenv("USER") + `/indexima

Define the HDFS directory used to share the application binaries and configuration files when deploying an Indexima cluster in Hadoop.

example: yarn.dir = hdfs://localhost:8020/tmp/indexima

yarn.name

Name of the Indexima cluster

example: yarn.name = indexima_prod

yarn.kerberos

Must be true if the Indexima data engine is running in an Hadoop cluster secured by Kerberos

example: yarn.kerberos = true

yarn.relax-locality

Defines the YARN relax locality policy during deployment.

example: yarn.relax-locality = false

yarn.racks

spill.enable

 Enable spill to disk function

Yes

Memory size taken to process queries before being spilled on disk. When the size of query elements is greater than this value, queries will start spilling on disk.

spill.disk.path

Folder on the disk of each node where elements will be spilled.

external.field.max_size

Cron expression for table synchronization check, more precise than external.synchronize.check.rate

analyser.smart.metrics.days

analyser.smart.weight.delegate

nodes.connect.timeout.seconds

Number of seconds to wait before starting the Indexima cluster with a missing node member.

This option allows starting a stand-alone Indexima cluster without taking the precaution to start all workers before the master.