Skip to content

Contributing to dbt-tags

dbt-tags is open-source dbt package ❤ī¸. Whether you are a seasoned open-source contributor or a first-time committer, we welcome and encourage you to contribute code, documentation, ideas, or problem statements to this project.

About this document

There are many ways to contribute to the ongoing development of dbt-tags, such as by participating in discussions and issues.

The rest of this document serves as a more granular guide for contributing code changes to dbt-tags (this repository). It is not intended as a guide for using dbt-tags, and some pieces assume a level of familiarity with Python development with poetry. Specific code snippets in this guide assume you are using macOS or Linux and are comfortable with the command line.

  • Branches: All pull requests from community contributors should target the main branch (default). If the change is needed as a patch for a minor version of dbt that has already been released (or is already a release candidate), a maintainer will backport the changes in your PR to the relevant "latest" release branch (1.0.<latest>, 1.1.<latest>, ...). If an issue fix applies to a release branch, that fix should be first committed to the development branch and then to the release branch (rarely release-branch fixes may not apply to main).
  • Releases: Before releasing a new minor version, we prepare a series of beta release candidates to allow users to test the new version in live environments. This is an important quality assurance step, as it exposes the new code to a wide variety of complicated deployments and can surface bugs before official release. Releases are accessible via pip.

Getting the code

Installing git

You will need git in order to download and modify the dbt-tags source code. On macOS, the best way to download git is to just install Xcode.

External contributors

You can contribute to dbt-tags by forking the dbt-tags repository. For a detailed overview on forking, check out the GitHub docs on forking. In short, you will need to:

  1. Fork the dbt-tags repository
  2. Clone your fork locally
  3. Check out a new branch for your proposed changes
  4. Push changes to your fork
  5. Open a pull request against infintelambda/dbt-tags from your forked repository

Setting up an environment

There are some tools that will be helpful to you in developing locally. While this is the list relevant for dbt-tags development, many of these tools are used commonly across open-source python projects.

Tools

We will buy poetry in dbt-tags development and testing.

So first install poetry via pip or via the official installer, please help to check right version used in poetry.lock file. Then, start installing the local environment:

poetry install
poetry shell
poe git-hooks

ℹī¸ If you receive an error on poetry install when trying to install dbt-tags, create an empty file dbt-tags in the root directory and try again, this should fix the issue.

Get dbt profile ready

Please help to check the sample script to initialize Snowflake environment in integration_tests/ci directory, and get your database freshly created.

Next, you should follow dbt profile instruction and setting up your dedicated profile. Again, you could try our sample in the same above directory.

Run poe dbt-tags-verify for verifying the connection ✅

Linting

We're trying to also maintain the code quality leveraging sqlfluff.

It is highly encouraged that you format the code before commiting using the below poe helpers:

poe lint    # check your code, we run this check in CI
poe format  # format your code to match sqlfluff configs

Testing

Once you're able to manually test that your code change is working as expected, it's important to run existing automated tests, as well as adding some new ones. These tests will ensure that:

  • Your code changes do not unexpectedly break other established functionality
  • Your code changes can handle all known edge cases
  • The functionality you're adding will keep working in the future

See here for details for running existing integration tests and adding new ones:

An integration test typically involves making 1) a new seed file 2) a new model file 3) a generic test to assert anticipated behaviour.

Once you've added all of these files, in the poetry shell, you should be able to run:

ℹī¸ If you are using Windows OS, make sure that you Developer Mode activated on your machine. This is so that symlinks can be created by the command line when installing the main dbt-tags project into the integration_tests sub-project. If it is not enabled, it will go into an endless loop of installing the packages inside each other over and over again until you run out of HD space.

ℹī¸ If you get an error when running the below due to a conflict when it is trying to run dbt deps from within integration_tests when using vs code, then this is likely due to a conflict with one or more extensions. Either disable extensions in vs code, such as dbt power user, or you can close vs code and run dbt deps directly from a command prompt window once you've cd'd into the correct folder.

poe dbt-tags-test

Committing

Upon running poe git-hooks we will make sure that you provide as the clean & neat commit messages as possible.

There are 2 main checks:

  • Trailing whitespace: If any, it will try to fix it for us, and we have to stage the changes before committing
  • Commit message: It must follow the commitizen convention as {change_type}: {message}
  • change_type: is one of feat|fix|chore|refactor|perf|BREAKING CHANGE

Submitting a Pull Request

Code can be merged into the current development branch main by opening a pull request. A dbt-tags maintainer will review your PR. They may suggest code revision for style or clarity, or request that you add unit or integration test(s). These are good things! We believe that, with a little bit of help, anyone can contribute high-quality code.

Automated tests run via GitHub Actions. If you're a first-time contributor, all tests (including code checks and unit tests) will require a maintainer to approve. Changes in the dbt-tags repository trigger integration tests against Snowflake 💰.

Once all tests are passing and your PR has been approved, a dbt-tags maintainer will merge your changes into the active development branch. And that's it!

Happy Developing 🎉