kedro-org/kedro
1
0
Fork 0
mirror of https://github.com/kedro-org/kedro.git synced 2026-03-27 08:51:06 +00:00
Code Issues Packages Projects Releases Wiki Activity
4,257 Commits 43 Branches 72 Tags
main
Commit Graph

73 Commits

Author SHA1 Message Date
Deepyaman Datta
5ed5a6d999 Delete extraneous workflow to check dep resolution (#5380) 
* Delete extraneous workflow to check dep resolution

Signed-off-by: Deepyaman Datta <deepyaman.datta@utexas.edu>

* Remove deleted pip-compile job from all-checks.yml

Delete extraneous workflow to check dep resolution

Signed-off-by: Deepyaman Datta <deepyaman.datta@utexas.edu>

* Make install-test-reqs more like install-lint-reqs

Signed-off-by: Deepyaman Datta <deepyaman.datta@utexas.edu>

---------

Signed-off-by: Deepyaman Datta <deepyaman.datta@utexas.edu>
 2026-02-25 23:51:33 +00:00
rashidakanchwala
d25c210786 Fix: remove --system flag from uv pip freeze in CI (#5385) 
This PR updates the CI workflow to use:

uv pip freeze

instead of:

uv pip freeze --system

This is because the workflow installs uv with activate-environment: true, meaning dependencies and tests run inside an activated virtual environment.

uv pip freeze --system targets the system Python environment, which in CI only showed:

pip @ file:///build/pip-26.0.1-py3-none-any.whl and did not reflect the installed project dependencies. See (https://github.com/kedro-org/kedro/actions/runs/22089164341/job/63830206755?pr=5379)

Switching to uv pip freeze ensures we freeze the same environment used for installing dependencies and running test
 2026-02-20 09:13:13 +00:00
rashidakanchwala
9cc94d03ff Remove temporary kedro-datasets test override and temporarily skip failing test (#5374) 2026-02-13 13:24:49 +00:00
rashidakanchwala
672950b877 Remove cachetools dependency (#5352) 
Cachetools 7 introduced several breaking changes that made @cachedmethod significantly stricter, including converting it into a descriptor and requiring instances to have a mutable __dict__.
These assumptions do not align well with Kedro’s ParallelRunner, which relies on pickling and unpickling dataset instances across processes, and this resulted in runtime failures when upgrading to cachetools 7. Although pinning the dependency avoided the immediate issue, further investigation showed that cachetools is not well-suited to this use case. Kedro only caches two values per dataset instance (the resolved load and save versions) and does not require eviction policies, TTLs, or multi-key caching.

As a long-term solution, this change removes the cachetools dependency and replaces it with lightweight manual caching. This simplifies the implementation, removes an unnecessary dependency, and avoids future breakages in parallel execution.
 2026-02-10 15:52:18 +00:00
dependabot[bot]
adfe94c848 Bump actions/cache from 4 to 5 in the actions group (#5299) 
Bumps the actions group with 1 update: [actions/cache](https://github.com/actions/cache).


Updates `actions/cache` from 4 to 5
- [Release notes](https://github.com/actions/cache/releases)
- [Changelog](https://github.com/actions/cache/blob/main/RELEASES.md)
- [Commits](https://github.com/actions/cache/compare/v4...v5)

---
updated-dependencies:
- dependency-name: actions/cache
  dependency-version: '5'
  dependency-type: direct:production
  update-type: version-update:semver-major
  dependency-group: actions
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: ElenaKhaustova <157851531+ElenaKhaustova@users.noreply.github.com>
 2026-01-05 09:48:52 +00:00
Ravi Kumar Pilla
5ed3758cc7 Fix broken doc links (#5260) 
* fix broken links

* add git action for link check within codebase

* add git action for link check within codebase

* add git action for link check within codebase

* link check for yml

* testing asv benchmark

* testing asv benchmark

* testing asv benchmark

* revert testing asv benchmark

* lychee check in docslink

* lychee test in docslink

* update ignore file

* update ignore file

* final test
 2025-12-10 09:24:37 -06:00
dependabot[bot]
8eff156351 Bump actions/checkout from 5 to 6 in the actions group (#5248) 
Bumps the actions group with 1 update: [actions/checkout](https://github.com/actions/checkout).


Updates `actions/checkout` from 5 to 6
- [Release notes](https://github.com/actions/checkout/releases)
- [Changelog](https://github.com/actions/checkout/blob/main/CHANGELOG.md)
- [Commits](https://github.com/actions/checkout/compare/v5...v6)

---
updated-dependencies:
- dependency-name: actions/checkout
  dependency-version: '6'
  dependency-type: direct:production
  update-type: version-update:semver-major
  dependency-group: actions
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2025-12-02 13:52:17 +01:00
dependabot[bot]
b3a56b4a34 Bump the actions group with 3 updates (#5191) 
Bumps the actions group with 3 updates: [actions/checkout](https://github.com/actions/checkout), [actions/setup-python](https://github.com/actions/setup-python) and [astral-sh/setup-uv](https://github.com/astral-sh/setup-uv).


Updates `actions/checkout` from 4 to 5
- [Release notes](https://github.com/actions/checkout/releases)
- [Changelog](https://github.com/actions/checkout/blob/main/CHANGELOG.md)
- [Commits](https://github.com/actions/checkout/compare/v4...v5)

Updates `actions/setup-python` from 5 to 6
- [Release notes](https://github.com/actions/setup-python/releases)
- [Commits](https://github.com/actions/setup-python/compare/v5...v6)

Updates `astral-sh/setup-uv` from 6 to 7
- [Release notes](https://github.com/astral-sh/setup-uv/releases)
- [Commits](https://github.com/astral-sh/setup-uv/compare/v6...v7)

---
updated-dependencies:
- dependency-name: actions/checkout
  dependency-version: '5'
  dependency-type: direct:production
  update-type: version-update:semver-major
  dependency-group: actions
- dependency-name: actions/setup-python
  dependency-version: '6'
  dependency-type: direct:production
  update-type: version-update:semver-major
  dependency-group: actions
- dependency-name: astral-sh/setup-uv
  dependency-version: '7'
  dependency-type: direct:production
  update-type: version-update:semver-major
  dependency-group: actions
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2025-11-03 14:43:54 +01:00
L. R. Couto
6a94c02430 Run MKDocs strict validation on new commit pushes. (#5173) 
* Add linkcheck job to github CI

Signed-off-by: Laura Couto <laurarccouto@gmail.com>

* Add permissions

Signed-off-by: Laura Couto <laurarccouto@gmail.com>

* Run on all pushes

Signed-off-by: Laura Couto <laurarccouto@gmail.com>

* Edit  the correct file

Signed-off-by: Laura Couto <laurarccouto@gmail.com>

* Install UV the same way we do on unit tests

Signed-off-by: Laura Couto <laurarccouto@gmail.com>

* Fix MKdocs warnings

Signed-off-by: Laura Couto <laurarccouto@gmail.com>

* Lint

Signed-off-by: Laura Couto <laurarccouto@gmail.com>

* Add Lychee to github CI job

Signed-off-by: Laura Couto <laurarccouto@gmail.com>

* Install lychee with cargo

Signed-off-by: Laura Couto <laurarccouto@gmail.com>

* Add stricter validation to docs, fix broken anchors

Signed-off-by: Laura Couto <laurarccouto@gmail.com>

* Remove lychee from CI

Signed-off-by: Laura Couto <laurarccouto@gmail.com>

* Make anchor links more specific, run lincheck only on python 3.11

Signed-off-by: Laura Couto <laurarccouto@gmail.com>

* Update docs/build/slice_a_pipeline.md

Co-authored-by: Merel Theisen <49397448+merelcht@users.noreply.github.com>
Signed-off-by: L. R. Couto <57910428+lrcouto@users.noreply.github.com>

* Update docs/tutorials/add_another_pipeline.md

Co-authored-by: Merel Theisen <49397448+merelcht@users.noreply.github.com>
Signed-off-by: L. R. Couto <57910428+lrcouto@users.noreply.github.com>

---------

Signed-off-by: Laura Couto <laurarccouto@gmail.com>
Signed-off-by: L. R. Couto <57910428+lrcouto@users.noreply.github.com>
Co-authored-by: Merel Theisen <49397448+merelcht@users.noreply.github.com>
 2025-10-24 13:38:17 +00:00
L. R. Couto
7187832804 Remove Python 3.9 support (#5165) 
* Deprecate Python 3.9

Signed-off-by: Laura Couto <laurarccouto@gmail.com>

* Adjust tests to change importlib_resources into importlib.resources

Signed-off-by: Laura Couto <laurarccouto@gmail.com>

* Adjust tests to change importlib_metadata into importlib.metadata

Signed-off-by: Laura Couto <laurarccouto@gmail.com>

* Lint

Signed-off-by: Laura Couto <laurarccouto@gmail.com>

* Update release notes and README

Signed-off-by: Laura Couto <laurarccouto@gmail.com>

* Lint

Signed-off-by: Laura Couto <laurarccouto@gmail.com>

---------

Signed-off-by: Laura Couto <laurarccouto@gmail.com>
 2025-10-20 13:03:01 +00:00
dependabot[bot]
37358c313a Bump the actions group with 4 updates (#5153) 
Bumps the actions group with 4 updates: [actions/setup-python](https://github.com/actions/setup-python), [softprops/action-gh-release](https://github.com/softprops/action-gh-release), [actions/github-script](https://github.com/actions/github-script) and [peter-evans/repository-dispatch](https://github.com/peter-evans/repository-dispatch).


Updates `actions/setup-python` from 5 to 6
- [Release notes](https://github.com/actions/setup-python/releases)
- [Commits](https://github.com/actions/setup-python/compare/v5...v6)

Updates `softprops/action-gh-release` from 1 to 2
- [Release notes](https://github.com/softprops/action-gh-release/releases)
- [Changelog](https://github.com/softprops/action-gh-release/blob/master/CHANGELOG.md)
- [Commits](https://github.com/softprops/action-gh-release/compare/v1...v2)

Updates `actions/github-script` from 6 to 8
- [Release notes](https://github.com/actions/github-script/releases)
- [Commits](https://github.com/actions/github-script/compare/v6...v8)

Updates `peter-evans/repository-dispatch` from 2 to 4
- [Release notes](https://github.com/peter-evans/repository-dispatch/releases)
- [Commits](https://github.com/peter-evans/repository-dispatch/compare/v2...v4)

---
updated-dependencies:
- dependency-name: actions/setup-python
  dependency-version: '6'
  dependency-type: direct:production
  update-type: version-update:semver-major
  dependency-group: actions
- dependency-name: softprops/action-gh-release
  dependency-version: '2'
  dependency-type: direct:production
  update-type: version-update:semver-major
  dependency-group: actions
- dependency-name: actions/github-script
  dependency-version: '8'
  dependency-type: direct:production
  update-type: version-update:semver-major
  dependency-group: actions
- dependency-name: peter-evans/repository-dispatch
  dependency-version: '4'
  dependency-type: direct:production
  update-type: version-update:semver-major
  dependency-group: actions
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Merel Theisen <49397448+merelcht@users.noreply.github.com>
 2025-10-13 14:32:39 +01:00
Jitendra Gundaniya
21fcc1e820 Add explicit permissions block to GitHub Actions workflows (#5151) 2025-10-07 16:10:31 +01:00
Klaus Rettinghaus
0afcc435bb Update GitHub Actions (#5140) 
* chore: bump checkout action to version 5

Signed-off-by: Klaus Rettinghaus <klaus.rettinghaus@gmail.com>

* feat: add dependabot config for actions

Signed-off-by: Klaus Rettinghaus <klaus.rettinghaus@gmail.com>

* chore: update previously missed actions

Signed-off-by: Klaus Rettinghaus <klaus.rettinghaus@gmail.com>

---------

Signed-off-by: Klaus Rettinghaus <klaus.rettinghaus@gmail.com>
Co-authored-by: Ankita Katiyar <110245118+ankatiyar@users.noreply.github.com>
 2025-10-06 12:32:16 +01:00
Merel Theisen
44b33914a6 Use uv pip compile instead of pip-tools (#5033) 
* Temporarily pin pip-tools for compile

Signed-off-by: Merel Theisen <merel.theisen@quantumblack.com>

* Try use uv for pip compile instead

Signed-off-by: Merel Theisen <merel.theisen@quantumblack.com>

---------

Signed-off-by: Merel Theisen <merel.theisen@quantumblack.com>
 2025-08-01 12:09:58 +02:00
Ankita Katiyar
b2255cbeef CI cleanup (#5018) 
* Update actions

Signed-off-by: Ankita Katiyar <ankitakatiyar2401@gmail.com>

* Update install reqs command

Signed-off-by: Ankita Katiyar <ankitakatiyar2401@gmail.com>

* update pip compile test

Signed-off-by: Ankita Katiyar <ankitakatiyar2401@gmail.com>

* update pip compile test

Signed-off-by: Ankita Katiyar <ankitakatiyar2401@gmail.com>

* Update detect secrets

Signed-off-by: Ankita Katiyar <ankitakatiyar2401@gmail.com>

* final

Signed-off-by: Ankita Katiyar <ankitakatiyar2401@gmail.com>

* final

Signed-off-by: Ankita Katiyar <ankitakatiyar2401@gmail.com>

* Fix e2e

Signed-off-by: Ankita Katiyar <ankitakatiyar2401@gmail.com>

---------

Signed-off-by: Ankita Katiyar <ankitakatiyar2401@gmail.com>
 2025-07-29 15:50:34 +01:00
Juan Luis Cano Rodríguez
94c35e92d0 Simplify e2e tests (#5003) 
* Update e2e-tests.yml

* Update e2e-tests.yml

* Remove caching step

Signed-off-by: Ankita Katiyar <ankitakatiyar2401@gmail.com>

---------

Signed-off-by: Ankita Katiyar <ankitakatiyar2401@gmail.com>
Co-authored-by: Ankita Katiyar <110245118+ankatiyar@users.noreply.github.com>
Co-authored-by: Ankita Katiyar <ankitakatiyar2401@gmail.com>
 2025-07-25 16:35:33 +00:00
Ankita Katiyar
03cf6c3ef0 Remove fallback version check for starters (#4989) 
* Try token for CI

Signed-off-by: Ankita Katiyar <ankitakatiyar2401@gmail.com>

* Temp: add logging line

Signed-off-by: Ankita Katiyar <ankitakatiyar2401@gmail.com>

* Remove version check

Signed-off-by: Ankita Katiyar <ankitakatiyar2401@gmail.com>

* Remove tests

Signed-off-by: Ankita Katiyar <ankitakatiyar2401@gmail.com>

* remove extra tests

Signed-off-by: Ankita Katiyar <ankitakatiyar2401@gmail.com>

---------

Signed-off-by: Ankita Katiyar <ankitakatiyar2401@gmail.com>
 2025-07-21 10:56:48 +01:00
Kitsios Konstantinos
c9391d68db Added custom CI timeout to save resources and speed up the CI (#4962) 
Signed-off-by: Konstantinos <konstantinos.kitsios@uzh.ch>
Co-authored-by: Ankita Katiyar <110245118+ankatiyar@users.noreply.github.com>
 2025-07-15 10:58:22 +00:00
rashidakanchwala
2a8e86c02a Support pre-release versions (rc/b/a) in release workflow #4812 
This PR updates our release tooling so that versions with an a, b, or rc suffix (e.g. 1.0.0b1, 2.0.0rc2) are recognized as pre-releases. It includes the following changes:

github_actions_release.py

Expanded the VERSION_MATCHSTR regex (version = "\d+.\d+.\d+") to allow optional a|b|rc suffixes followed by digits. Now get_package_version() correctly returns strings like 1.0.0b1 or 2.0.0rc1 instead of None.
GitHub Actions workflow (check-release.yml)

Added a “Determine if version is pre-release” step that looks for (a|b|rc) in kedro_version.
Updated the “Create GitHub Release” action to use prerelease: ${{ steps.detect_prerelease.outputs.is_prerelease }} so that any version containing a, b, or rc is automatically flagged as a GitHub pre-release.
Development notes
 2025-06-13 13:08:17 +01:00
ElenaKhaustova
f72d5cded3 Renamed job (#4411) 
Signed-off-by: Elena Khaustova <ymax70rus@gmail.com>
 2025-01-13 15:22:26 +00:00
ElenaKhaustova
396a1f52e4 Replace trufflehog with detect-secrets (#4404) 
* Added secret-scan

Signed-off-by: Elena Khaustova <ymax70rus@gmail.com>

* Removed trufflehog

Signed-off-by: Elena Khaustova <ymax70rus@gmail.com>

* Removed secret scan pre-commit hook

Signed-off-by: Elena Khaustova <ymax70rus@gmail.com>

* Added action to detect secrets

Signed-off-by: Elena Khaustova <ymax70rus@gmail.com>

* Renamed scan command for GH action

Signed-off-by: Elena Khaustova <ymax70rus@gmail.com>

* Detect secrets test

Signed-off-by: Elena Khaustova <ymax70rus@gmail.com>

* Removed test check

Signed-off-by: Elena Khaustova <ymax70rus@gmail.com>

* Updated release notes

Signed-off-by: Elena Khaustova <ymax70rus@gmail.com>

---------

Signed-off-by: Elena Khaustova <ymax70rus@gmail.com>
 2025-01-09 14:57:51 +00:00
Ankita Katiyar
847c433304 Document the convention for filepath related attributes in custom dataset creation (#4403) 
* Document the magic behaviour of filepath attributes

Signed-off-by: Ankita Katiyar <ankitakatiyar2401@gmail.com>

* pin vale

Signed-off-by: Ankita Katiyar <ankitakatiyar2401@gmail.com>

---------

Signed-off-by: Ankita Katiyar <ankitakatiyar2401@gmail.com>
 2025-01-09 12:21:58 +00:00
Nok Lam Chan
01c095b253 Add official support for Python 3.13 (#4328) 
* add 3.13 support

Signed-off-by: Nok <nok.lam.chan@quantumblack.com>

* bump uv

Signed-off-by: Nok <nok.lam.chan@quantumblack.com>

* bump ruff

Signed-off-by: Nok <nok.lam.chan@quantumblack.com>

* update test

Signed-off-by: Nok <nok.lam.chan@quantumblack.com>

* update test  & README

Signed-off-by: Nok <nok.lam.chan@quantumblack.com>

* readme

Signed-off-by: Nok <nok.lam.chan@quantumblack.com>

* fix with temp_dir without cleanup

Signed-off-by: Nok <nok.lam.chan@quantumblack.com>

* add cleanup

Signed-off-by: Nok <nok.lam.chan@quantumblack.com>

* trigger CI

Signed-off-by: Nok <nok.lam.chan@quantumblack.com>

* fix test

* update release note

* address PR comment

---------

Signed-off-by: Nok <nok.lam.chan@quantumblack.com>
Signed-off-by: Nok Lam Chan <nok.lam.chan@quantumblack.com>
Co-authored-by: ravi-kumar-pilla <ravi_kumar_pilla@mckinsey.com>
 2024-11-15 10:23:52 -06:00
Merel Theisen
6e3e4d1831 Increase close time of info needed tickets to 28 (#4304) 
Signed-off-by: Merel Theisen <merel.theisen@quantumblack.com>
 2024-11-07 17:09:19 +00:00
Merel Theisen
bc96964b2a Remove broken action to move issues to column (#4300) 
Signed-off-by: Merel Theisen <merel.theisen@quantumblack.com>
 2024-11-07 08:50:25 +00:00
Merel Theisen
826021d699 Wizard automation: check for response on "info needed" issue & close (#4294) 
* Add action that checks for responses on info needed and closes after 14 days

Signed-off-by: Merel Theisen <merel.theisen@quantumblack.com>
 2024-11-06 12:19:38 +00:00
Merel Theisen
be15df5b29 Add action to move issues labelled with more info needed to column on Wizard board (#4295) 
Signed-off-by: Merel Theisen <merel.theisen@quantumblack.com>
 2024-11-05 15:13:13 +01:00
Merel Theisen
a1fae5018f Wizard actions (#4286) 2024-11-01 11:41:43 +00:00
Merel Theisen
6f43a42965 Wizard actions (#4284) 2024-11-01 11:34:49 +00:00
Merel Theisen
85e955be0c Wizard actions (#4282) 
* Add GH action to automatically label community issues

Signed-off-by: Merel Theisen <merel.theisen@quantumblack.com>

* Test action

Signed-off-by: Merel Theisen <merel.theisen@quantumblack.com>

* Undo test stuf

Signed-off-by: Merel Theisen <merel.theisen@quantumblack.com>

* Update label action

Signed-off-by: Merel Theisen <merel.theisen@quantumblack.com>

* Update label action

Signed-off-by: Merel Theisen <merel.theisen@quantumblack.com>

* Add console logs to error

Signed-off-by: Merel Theisen <merel.theisen@quantumblack.com>

---------

Signed-off-by: Merel Theisen <merel.theisen@quantumblack.com>
Signed-off-by: Merel Theisen <49397448+merelcht@users.noreply.github.com>
 2024-11-01 11:30:38 +00:00
Merel Theisen
34c42fc825 Add GH action to automatically label community issues (#4279) 
* Add GH action to automatically label community issues

Signed-off-by: Merel Theisen <merel.theisen@quantumblack.com>

* Test action

Signed-off-by: Merel Theisen <merel.theisen@quantumblack.com>

* Undo test stuf

Signed-off-by: Merel Theisen <merel.theisen@quantumblack.com>

* Update label action

Signed-off-by: Merel Theisen <merel.theisen@quantumblack.com>

* Update label action

Signed-off-by: Merel Theisen <merel.theisen@quantumblack.com>

---------

Signed-off-by: Merel Theisen <merel.theisen@quantumblack.com>
 2024-11-01 11:13:24 +00:00
L. R. Couto
a5d9bb4038 Add Github Actions workflow to trigger pipeline performance test (#4231) 
* Add Github Actions workflow to trigger pipeline performance test

Signed-off-by: Laura Couto <laurarccouto@gmail.com>

* Lint

Signed-off-by: Laura Couto <laurarccouto@gmail.com>

* Lint

Signed-off-by: Laura Couto <laurarccouto@gmail.com>

* Change trigger to PR label

Signed-off-by: Laura Couto <laurarccouto@gmail.com>

* Run workflow on kedro repo

Signed-off-by: Laura Couto <laurarccouto@gmail.com>

* Change setup-python version to 5

Signed-off-by: L. R. Couto <57910428+lrcouto@users.noreply.github.com>

---------

Signed-off-by: Laura Couto <laurarccouto@gmail.com>
Signed-off-by: L. R. Couto <57910428+lrcouto@users.noreply.github.com>
 2024-10-25 12:57:40 -03:00
Yu-Sheng Li
4fa311b113 Remove support for Python 3.8 (#4212) 
* Remove support for Python 3.8

Signed-off-by: kevin1kevin1k <kevin1kevin1k@gmail.com>
Co-authored-by: Ankita Katiyar <110245118+ankatiyar@users.noreply.github.com>
 2024-10-08 10:01:56 +01:00
Ankita Katiyar
a268b974a7 Add performance testing setup to Kedro (#4172) 
* Add asv test setup

Signed-off-by: Ankita Katiyar <ankitakatiyar2401@gmail.com>

* lint

Signed-off-by: Ankita Katiyar <ankitakatiyar2401@gmail.com>

---------

Signed-off-by: Ankita Katiyar <ankitakatiyar2401@gmail.com>
 2024-09-23 16:16:08 +00:00
Merel Theisen
1b51382e62 Use uv in GH actions + Makefile commands where possible (#3688) 
Signed-off-by: Merel Theisen <merel.theisen@quantumblack.com>
 2024-04-18 10:57:39 +00:00
Juan Luis Cano Rodríguez
338736e3c8 Add official support for Python 3.12 (#3587) 
* Add official support for Python 3.12

Close #3287.

Signed-off-by: Juan Luis Cano Rodríguez <juan_luis_cano@mckinsey.com>

* Mark broken test as xfail

Signed-off-by: Juan Luis Cano Rodríguez <juan_luis_cano@mckinsey.com>

* Overwrite inherited get to use __getitem__

Signed-off-by: Ahdra Merali <ahdra.merali@quantumblack.com>

* Appease mypy

Signed-off-by: Ahdra Merali <ahdra.merali@quantumblack.com>

* Fix test

Signed-off-by: Ahdra Merali <ahdra.merali@quantumblack.com>

* Fix test coverage

Signed-off-by: Ahdra Merali <ahdra.merali@quantumblack.com>

* Use spy instead of patch

Signed-off-by: Ahdra Merali <ahdra.merali@quantumblack.com>

* Make comment more clear

Signed-off-by: Ahdra Merali <ahdra.merali@quantumblack.com>

---------

Signed-off-by: Juan Luis Cano Rodríguez <juan_luis_cano@mckinsey.com>
Signed-off-by: Ahdra Merali <ahdra.merali@quantumblack.com>
Signed-off-by: Ahdra Merali <90615669+AhdraMeraliQB@users.noreply.github.com>
Co-authored-by: Ahdra Merali <ahdra.merali@quantumblack.com>
Co-authored-by: Ahdra Merali <90615669+AhdraMeraliQB@users.noreply.github.com>
 2024-03-12 10:08:12 +00:00
Nok Lam Chan
64296cfc75 Remove pip-tools from kedro[test] (#3596) 
* Remove `pip-tools` from `kedro[test]`

Obsolete dependency

Signed-off-by: Nok Lam Chan <nok.lam.chan@quantumblack.com>

* move pip-compile

Signed-off-by: Nok <nok.lam.chan@quantumblack.com>

---------

Signed-off-by: Nok Lam Chan <nok.lam.chan@quantumblack.com>
Signed-off-by: Nok <nok.lam.chan@quantumblack.com>
 2024-02-08 20:18:57 +00:00
Ankita Katiyar
9b11c593a8 Unpin pip version and bump actions versions (#3598) 
* Unpin pip version

Signed-off-by: Ankita Katiyar <ankitakatiyar2401@gmail.com>

* Bump versions of actions

Signed-off-by: Ankita Katiyar <ankitakatiyar2401@gmail.com>

* Upgrade pip

Signed-off-by: Ankita Katiyar <ankitakatiyar2401@gmail.com>

* Update command

Signed-off-by: Ankita Katiyar <ankitakatiyar2401@gmail.com>

* Update pip version in e2e tests

Signed-off-by: Ankita Katiyar <ankitakatiyar2401@gmail.com>

* Add lower bound and remove comments

Signed-off-by: Ankita Katiyar <ankitakatiyar2401@gmail.com>

* Bump actions versions on release

Signed-off-by: Ankita Katiyar <ankitakatiyar2401@gmail.com>

---------

Signed-off-by: Ankita Katiyar <ankitakatiyar2401@gmail.com>
Co-authored-by: Nok Lam Chan <nok.lam.chan@quantumblack.com>
 2024-02-06 11:14:38 +00:00
Ankita Katiyar
dcad26ecb8 Update auto-merge action to use bash script (#3595) 
* Add bash script for merging PRs

Signed-off-by: Ankita Katiyar <ankitakatiyar2401@gmail.com>

* Remove labeler action

Signed-off-by: Ankita Katiyar <ankitakatiyar2401@gmail.com>

---------

Signed-off-by: Ankita Katiyar <ankitakatiyar2401@gmail.com>
 2024-02-05 15:50:08 +00:00
Ankita Katiyar
de435f23a5 Update token on auto-merge action (#3570) 2024-01-29 17:43:36 +00:00
Ankita Katiyar
777f73becb Update sync job with token for checkout step (#3526) 
* Update token on sync job

Signed-off-by: Ankita Katiyar <ankitakatiyar2401@gmail.com>

* Update sync job to use token for checkout

Signed-off-by: Ankita Katiyar <ankitakatiyar2401@gmail.com>

---------

Signed-off-by: Ankita Katiyar <ankitakatiyar2401@gmail.com>
 2024-01-18 11:33:40 +00:00
Ankita Katiyar
33d9e368d9 Update token on sync job (#3523) 
Signed-off-by: Ankita Katiyar <ankitakatiyar2401@gmail.com>
 2024-01-17 18:57:58 +00:00
Ankita Katiyar
4dafc47919 Migrate sync job to GitHub Actions and remove CircleCI config (#3508) 
* Add sync, label and merge jobs

Signed-off-by: Ankita Katiyar <ankitakatiyar2401@gmail.com>

* Add comments to the workflows

Signed-off-by: Ankita Katiyar <ankitakatiyar2401@gmail.com>

* Update merge gatekeeper

Signed-off-by: Ankita Katiyar <ankitakatiyar2401@gmail.com>

---------

Signed-off-by: Ankita Katiyar <ankitakatiyar2401@gmail.com>
 2024-01-17 14:47:45 +00:00
Sajid Alam
b499da0f8b Move the release process to GitHub Actions (#3491) 
* add github actions release scripts

Signed-off-by: Sajid Alam <sajid_alam@mckinsey.com>

* remove circleci release code

Signed-off-by: Sajid Alam <sajid_alam@mckinsey.com>

* lint

Signed-off-by: Sajid Alam <sajid_alam@mckinsey.com>

* Update github_actions_release.py

Signed-off-by: Sajid Alam <sajid_alam@mckinsey.com>

* Update check-release.yml

Signed-off-by: Sajid Alam <sajid_alam@mckinsey.com>

---------

Signed-off-by: Sajid Alam <sajid_alam@mckinsey.com>
 2024-01-11 15:53:49 +00:00
Sajid Alam
190d2f7d9c Add E2E test for tools (#3325) 
* Update new.feature

Signed-off-by: SajidAlamQB <90610031+SajidAlamQB@users.noreply.github.com>

* Update new.feature

Signed-off-by: SajidAlamQB <90610031+SajidAlamQB@users.noreply.github.com>

* Update new.feature

* add-ons e2e test

* fix minor errors

* update e2e add-ons

* add tests for pyspark and viz

* install dependencies

* lint

* add hadoop

* Update cli_steps.py

* Update e2e-tests.yml

* add java to ENV

* use java github action

* remove hadoop

* dummy hadoop

* fix version

* add VC++

* Update e2e-tests.yml

* Update e2e-tests.yml

* Update e2e-tests.yml

* use only choco

* Update e2e-tests.yml

* hadoop_home attempt 2

* revert choco installs

* try hadoop 2.7.1 and try starters hadoop fix

* Update e2e-tests.yml

* Update e2e-tests.yml

* add file check for all addons

* lint

* update add-ons e2e test

* rename to tools

Signed-off-by: SajidAlamQB <90610031+SajidAlamQB@users.noreply.github.com>

* Update cli_steps.py

Signed-off-by: SajidAlamQB <90610031+SajidAlamQB@users.noreply.github.com>

* changes based on review

Signed-off-by: SajidAlamQB <90610031+SajidAlamQB@users.noreply.github.com>

---------

Signed-off-by: SajidAlamQB <90610031+SajidAlamQB@users.noreply.github.com>
 2023-11-30 17:17:46 +00:00
Ankita Katiyar
1ba572de3a Move pip-tools to test requirements (#3338) 
* Move pip-tools to test requirements instead of GHA wf

Signed-off-by: Ankita Katiyar <ankitakatiyar2401@gmail.com>

* Link check

Signed-off-by: Ankita Katiyar <ankitakatiyar2401@gmail.com>

* Link check

Signed-off-by: Ankita Katiyar <ankitakatiyar2401@gmail.com>

---------

Signed-off-by: Ankita Katiyar <ankitakatiyar2401@gmail.com>
 2023-11-24 12:22:02 +00:00
Merel Theisen
8b4907d371 Remove pip-tools as dependency (#3329) 
Signed-off-by: Ankita Katiyar <ankitakatiyar2401@gmail.com>
Signed-off-by: Merel Theisen <merel.theisen@quantumblack.com>
 2023-11-22 13:18:31 +00:00
Ankita Katiyar
77516c099d Merge branch 'develop' into merge-main-to-develop 
Signed-off-by: Ankita Katiyar <110245118+ankatiyar@users.noreply.github.com>
 2023-10-30 10:55:59 +00:00
Nok Lam Chan
df9f174864 Change the order of CI, run windows test before ubuntu (#3224) 
* Change the order of CI, run windows test before ubuntu

Signed-off-by: Nok <nok.lam.chan@quantumblack.com>

* try to optimise job

Signed-off-by: Nok <nok.lam.chan@quantumblack.com>

---------

Signed-off-by: Nok <nok.lam.chan@quantumblack.com>
 2023-10-25 11:20:12 +00:00
Ankita Katiyar
209d952b2c Make nightly build on develop use make test instead of make test-no-spark (#3226) 
* Add condition for develop branch

Signed-off-by: Ankita Katiyar <ankitakatiyar2401@gmail.com>

* Update if statement

Signed-off-by: Ankita Katiyar <ankitakatiyar2401@gmail.com>

* Update if for make test-no-spark'

Signed-off-by: Ankita Katiyar <ankitakatiyar2401@gmail.com>

---------

Signed-off-by: Ankita Katiyar <ankitakatiyar2401@gmail.com>
 2023-10-25 11:35:46 +01:00