Thanks for taking the time for contribution to Cube! We're very welcoming community and while it's very much appreciated if you follow these guidelines it's not a requirement.
This project and everyone participating in it is governed by the Cube Code of Conduct. By participating, you are expected to uphold this code. Please report unacceptable behavior to [email protected].
Please review the following sections before proposing code changes.
- Cube Client is MIT licensed.
- Cube Backend is Apache 2.0 licensed.
By contributing to Cube Dev, Inc., You accept and agree to the terms and conditions in the Developer Certificate of Origin for Your present and future Contributions submitted to Cube Dev, Inc. Your contribution includes any submissions to the Cube repository when you click on such buttons as Propose changes
or Create pull request
. Except for the licenses granted herein, You reserve all right, title, and interest in and to Your Contributions.
- Find issues where we need help. Search for issues with either
good first issue
and/orhelp wanted
labels. - Follow the directions in the Getting Started guide to get Cube up and running (incl. the Developer Playground).
- Clone the Cube repo.
- Submit your Pull Request.
- Testing: Please include test(s) for your code contribution. Depending on a change it can be tested by unit, integration or E2E test. See some of the test examples for drivers and backend. There're separate packages for E2E testing and E2E driver testing. Tests are required for most of the contributions.
- Documentation: When new features are added or there are changes to existing features that require updates to documentation, we encourage you to add/update any missing documentation in the
/docs
folder. To update an existing documentation page, you can simply click on theEdit this page
button on the top right corner of the documentation page. - Relevant team(s) will be pinged automatically for a review based on information in the
CODEOWNERS
file.
Cube works with Node.js 20+ and uses Yarn as a package manager.
Cube offers two different types of Docker image:
- Stable (building from published release on npm)
- Dev (building from source files, needed to test unpublished changes)
For more information, take a look at Docker Development Guide.
- After cloning Cube repository run
yarn install
inpackages/cubejs-docker
to install dependencies. - Copy
yarn.lock
file from the project root to thepackages/cubejs-docker
folder and usedocker build -t cubejs/cube:latest -f latest.Dockerfile
inpackages/cubejs-docker
to build stable docker image manually.
- After cloning Cube repository run
yarn install
to install dependencies. - Use
docker build -t cubejs/cube:dev -f dev.Dockerfile ../../
inpackages/cubejs-docker
to build stable development image.
- After cloning Cube repository run
yarn install
in root directory. - Use
yarn link
to add these packages to link registry. - Perform required code changes.
- Use
yarn build
in the repository root to build CommonJS and UMD modules. - Use
yarn link @cubejs-client/core
and/oryarn link @cubejs-client/react
in your project to test changes applied. - Use
yarn test
where available to test your changes. - Ensure that any CommonJS and UMD modules are included as part of your commit.
To get set up quickly, you can perform 1) and 2) with one line from the cube
clone root folder:
$ cd packages/cubejs-client-core && yarn && yarn link && cd ../.. && cd packages/cubejs-client-react && yarn && yarn link && cd ../..
If you are going to develop a JDBC driver, you need to install Java with JDK.
Cube.is written in a mixture of JavaScript, TypeScript, and Rust. TypeScript and Rust are preferred for new code.
Attention: Cube uses TypeScript configured in incremental mode, which uses cache to speed up compilation,
but in some cases, you can run into a problem with a not recompiled file. To fix it, we recommend running$ yarn clean
and$ yarn tsc
.
- Clone the Cube repository,
git clone https://github.com/cube-js/cube
. - Run
yarn install
in the root directory. - Run
yarn build
in the root directory to build the frontend dependent packages. - Run
yarn build
inpackages/cubejs-playground
to build the frontend. - Run
yarn tsc:watch
to start the TypeScript compiler in watch mode. - Run
yarn link
inpackages/cubejs-<pkg>
for the drivers and dependent packages you intend to modify. - Run
yarn install
inpackages/cubejs-<pkg>
to install dependencies for drivers and dependent packages. - Run
yarn link @cubejs-backend/<pkg>
inpackages/cubejs-server-core
to link drivers and dependent packages. - Run
yarn link
inpackages/cubejs-server-core
. - Create or choose an existing project for testing. You can generate a new one with cubejs-cli tool.
- Run
yarn link @cubejs-backend/server-core
in your project directory. - Run
yarn dev
to start your testing project and verify changes.
Instead of running all of the above commands manually you can use the dev_env_setup.sh
script:
- Clone the Cube repository,
git clone https://github.com/cube-js/cube
. - Navigate to your working projects directory and run
/path/to/cube/repo/dev_env_setup.sh
. The script will ask you some questions and run all the required commands. In case you decide to create a new testing project, it will be created in the current directory (that is why you probably don't want to run this script within cube repo directory).
- Follow all the steps from the previous section. Make sure that the
yarn tsc:watch
daemon is running in the background. - Open the Cube project in WebStorm.
- Create a new configuration, using
./node_modules/.bin/cubejs-server
for Node Parameters and the directory of your test project for Working directory. - Run/Debug dev Cube servers using the new configuration.
To enhance the adoption of community-contributed drivers, we decided to split the database driver contribution process into multiple stages.
- Each driver which is planned to be contributed to the main Cube repository should be published first as an npm package. Please see Publishing Driver npm package on how to do that.
- This NPM package should be contributed to the list of Third-party community drivers.
- Please make sure each npm package has a README with instructions on how to install it to the official docker image and how to connect it to the database.
- Posting a backlink to an open-source repository would be a good idea here so people can provide feedback on it by posting issues.
- Before creating PR for the main repository, please make sure it's tested with the standard Cube E2E testing suite. An example of an E2E testing suite can be found here: https://github.com/cube-js/cube/blob/master/packages/cubejs-testing/test/driver-postgres.test.ts
- If you're creating PR for the main repo, please be prepared to become a maintainer for this driver and dedicate some time to it. There're no specific time requirements. As a rule of thumb, you should expect to spend time on a weekly basis.
- Due to limited resources Core team will review and merge driver PRs based on popularity and development activity.
- Copy existing driver package structure and name it in
@cubejs-backend/<db-name>-driver
format.@cubejs-backend/mysql-driver
is a very good candidate for copying this structure. - Please do not copy CHANGELOG.md.
- Name driver class and adjust package.json, README.md accordingly.
- As a rule of thumb please use only Pure JS libraries as a dependencies where possible. It increases driver adoption rate a lot.
- Typically, you need to implement only
query()
andtestConnection()
methods of driver. The rest will be done byBaseDriver
class. - If db requires connection pooling prefer use
generic-pool
implementation with settings similar to other db packages. - Make sure your driver has
release()
method in case DB expects graceful shutdowns for connections. - Please use yarn to add any dependencies and run
$ yarn
within the package before committing to ensure rightyarn.lock
is in place. - Add this driver dependency to cubejs-server-core/core/DriverDependencies.js.
If there's existing JDBC Driver in place for Database of interest you can just create DbTypes
configuration inside
cubejs-jdbc-driver/driver/JDBCDriver.ts.
Most of the time no additional adjustments required for base JDBCDriver
implementation as JDBC is pretty standard.
In case you need to tweak it a little please follow Implementing Driver steps but use JDBCDriver
as your base driver class.
- Find the most similar
BaseQuery
implementation in@cubejs-backend/schema-compiler/adapter
. - Copy it, adjust SQL generation accordingly and put it in driver package. Driver package will obtain
@cubejs-backend/schema-compiler
dependency from that point. - Add
static dialectClass()
method to your driver class which returnsBaseQuery
implementation for the database. For example:
const { BaseDriver } = require('@cubejs-backend/query-orchestrator');
const FooQuery = require('./FooQuery');
class FooDriver extends BaseDriver {
// ...
static dialectClass() {
return FooQuery;
}
}
If driver class contains static dialectClass()
method it'll be used to lookup corresponding SQL dialect. Otherwise, it will use the default dialect for the database type.
Cube looks up cubejs-{dbType}-driver
package among installed modules to fullfil driver dependency if there's no corresponding default driver for the specified database type.
For example one can publish cubejs-foo-driver
npm package to fullfil driver dependency for the foo
database type.
In order to run tests in cubejs-schema-compiler
package you need to have running Docker on your machine.
When it's up and running just use yarn test
in packages/cubejs-schema-compiler
to execute tests.
If you want to make changes to the Cube.js client packages and test them locally in your project you can do it the following way:
- Make the desired changes and run
yarn build
in the root directory (you can also useyarn watch
) - Go to the
~/some-path/cube.js/packages/cubejs-client-core
directory and runyarn link
. (You'll see the messages Registered "@cubejs-client/core") - Now you can link it in your project (e.g. /my-project/dashboard-app). You can do so running
yarn link "@cubejs-client/core"
If you want to make changes to the @cubejs-client/react
package you'll need a few extra steps
- Go to your project's node_modules directory and find the react package (e.g. /my-project/dashboard-app/node_modules/react and run
yarn link
- Go to the
~/some-path/cube.js/packages/cubejs-client-react
directory and runyarn link react
Now your project will be using the local packages.
NOTE: You might need to restart your project after linking the packages.
Please use cargo test
to test packages and cargo fmt
to format code before commit.
We're passionate about what code can do rather how it's formatted. But in order to make code and docs maintainable following style guides will be enforced. Following these guidelines is not a requirement, but you can save some time for maintainers if you apply those to your contribution beforehand.
- Run
yarn lint
in package before committing your changes. If package doesn't have lint script, please add it and run. There's one root.eslintrc.js
file for all packages except client ones. Client packages has it's own.eslintrc.js
files. - Run
yarn test
before committing if package has tests. - Please use conventional commits name for your PR. It'll be used to build change logs. All PRs are merged using the squash strategy. PR title usually would be used as a name for commit. So please make sure it has a sensible name.
- For the scope part of commit name please use package name if it's within one package or don't use it if change spans multiple packages. For example
feat(server-core):
orfix(cubestore):
. - Commit messages that are getting merged should contain mostly "Why" those changes are made as opposed to "What" changes are done. "Why" can be a feature, reference to issue or reasons to fix something like a chore.
- Do not reformat code you aren't really changing unless it's absolutely necessary (e.g. fixing linter). Such changes make it really hard to use git blame feature when we need to find a commit where line change of interest was introduced. Please do not include files that contain only reformatting changes in the commit.