Skip to content

Navigation Menu

Sign in
Appearance settings

Search code, repositories, users, issues, pull requests...

Provide feedback

We read every piece of feedback, and take your input very seriously.

Saved searches

Use saved searches to filter your results more quickly

Sign up
Appearance settings
This repository was archived by the owner on Oct 9, 2023. It is now read-only.

Comments

Extract CatalogClient from flytepropeller to flytestdlib#148

Draft
MorpheusXAUT wants to merge 2 commits intoflyteorg:master from
blackshark-ai:delete-artifact
Draft

Extract CatalogClient from flytepropeller to flytestdlib #148
MorpheusXAUT wants to merge 2 commits intoflyteorg:master from
blackshark-ai:delete-artifact

Conversation

@MorpheusXAUT
Copy link
Contributor

@MorpheusXAUT MorpheusXAUT commented Dec 15, 2022
edited
Loading

TL;DR

The CatalogClient implementation has been extracted from flytepropeller's source code and moved to flytestdlib as flyteadmin also needs access to the functionality.

Type

  • Bug Fix
  • Feature
  • Plugin

Are all requirements met?

  • Code completed
  • Smoke tested
  • Unit tests added
  • Code documentation added
  • Any pending items have an associated Issue

Complete description

The whole latest implementation of the catalog package was moved from flytepropeller to here since flyteadmin will need access to a client interacting with datacatalog for evicting cached executions.
Additionally, the new functionality for acquiring/releasing reservations via artifact tag as well as the deletion of artifacts was implemented for the datacatalog client.

The PR was created as a draft until the flyteidl and flyteplugins PRs have been merged and respective versions have been published.

Tracking Issue

flyteorg/flyte#2867

Follow-up issue

NA

Copy link

codecov bot commented Dec 15, 2022
edited
Loading

Codecov Report

Merging #148 (d6ec6db) into master (80d1624) will decrease coverage by 0.49%.
The diff coverage is 64.50%.

@@ Coverage Diff @@
## master #148 +/- ##
==========================================
- Coverage 67.94% 67.45% -0.50% 
==========================================
 Files 69 75 +6 
 Lines 4077 4756 +679 
==========================================
+ Hits 2770 3208 +438 
- Misses 1148 1348 +200 
- Partials 159 200 +41 
Flag Coverage Δ
unittests 67.45% <64.50%> (-0.50%) ⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files Coverage Δ
catalog/client.go 0.00% <0.00%> (ø)
catalog/config.go 0.00% <0.00%> (ø)
catalog/noop_catalog.go 0.00% <0.00%> (ø)
catalog/config_flags.go 30.00% <30.00%> (ø)
catalog/datacatalog/datacatalog.go 63.35% <63.35%> (ø)
catalog/datacatalog/transformer.go 80.71% <80.71%> (ø)

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

Implemented new datacatalog functionality required for cache eviction
Updated to latest unreleased version of flyteidl and flyteplugins
Signed-off-by: Nick Müller <nmueller@blackshark.ai>
Signed-off-by: Nick Müller <nmueller@blackshark.ai>
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Reviewers

@EngHabu EngHabu Awaiting requested review from EngHabu EngHabu will be requested when the pull request is marked ready for review EngHabu is a code owner

@katrogan katrogan Awaiting requested review from katrogan katrogan will be requested when the pull request is marked ready for review katrogan is a code owner

@kumare3 kumare3 Awaiting requested review from kumare3 kumare3 will be requested when the pull request is marked ready for review kumare3 is a code owner

@wild-endeavor wild-endeavor Awaiting requested review from wild-endeavor wild-endeavor will be requested when the pull request is marked ready for review wild-endeavor is a code owner

At least 1 approving review is required to merge this pull request.

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

AltStyle によって変換されたページ (->オリジナル) /