Skip to content

[BEAM-10674] Add Python CoGBK load test for streaming on Dataflow#12542

Merged
kamilwu merged 2 commits intoapache:masterfrom
kamilwu:python-cogbk-streaming
Aug 20, 2020
Merged

[BEAM-10674] Add Python CoGBK load test for streaming on Dataflow#12542
kamilwu merged 2 commits intoapache:masterfrom
kamilwu:python-cogbk-streaming

Conversation

@kamilwu
Copy link
Copy Markdown
Contributor

@kamilwu kamilwu commented Aug 12, 2020

Add CoGBK load test with streaming mode for Dataflow Python SDK.


Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily:

  • Choose reviewer(s) and mention them in a comment (R: @username).
  • Format the pull request title like [BEAM-XXX] Fixes bug in ApproximateQuantiles, where you replace BEAM-XXX with the appropriate JIRA issue, if applicable. This will automatically link the pull request to the issue.
  • Update CHANGES.md with noteworthy changes.
  • If this contribution is large, please file an Apache Individual Contributor License Agreement.

See the Contributor Guide for more tips on how to make review process smoother.

Post-Commit Tests Status (on master branch)

Lang SDK Dataflow Flink Samza Spark Twister2
Go Build Status --- Build Status --- Build Status ---
Java Build Status Build Status
Build Status
Build Status
Build Status
Build Status
Build Status
Build Status Build Status
Build Status
Build Status
Build Status
Python Build Status
Build Status
Build Status
Build Status
Build Status
Build Status
Build Status
Build Status
Build Status
Build Status
--- Build Status ---
XLang Build Status --- Build Status --- Build Status ---

Pre-Commit Tests Status (on master branch)

--- Java Python Go Website
Non-portable Build Status Build Status
Build Status
Build Status
Build Status Build Status
Portable --- Build Status --- ---

See .test-infra/jenkins/README for trigger phrase, status and link of all Jenkins jobs.

GitHub Actions Tests Status (on master branch)

Build python source distribution and wheels

See CI.md for more information about GitHub Actions CI.

@kamilwu
Copy link
Copy Markdown
Contributor Author

kamilwu commented Aug 12, 2020

Run Seed Job

@kamilwu
Copy link
Copy Markdown
Contributor Author

kamilwu commented Aug 12, 2020

Run Spotless PreCommit

@kamilwu
Copy link
Copy Markdown
Contributor Author

kamilwu commented Aug 12, 2020

Run Load Tests Python CoGBK Dataflow Streaming

@kamilwu
Copy link
Copy Markdown
Contributor Author

kamilwu commented Aug 12, 2020

Run Load Tests Python CoGBK Dataflow Batch

@kamilwu
Copy link
Copy Markdown
Contributor Author

kamilwu commented Aug 12, 2020

Run Python PreCommit

@kamilwu kamilwu marked this pull request as ready for review August 12, 2020 11:03
@kamilwu kamilwu force-pushed the python-cogbk-streaming branch from d84e5ed to 0d8566e Compare August 12, 2020 11:39
@kamilwu
Copy link
Copy Markdown
Contributor Author

kamilwu commented Aug 12, 2020

Run Seed Job

@kamilwu
Copy link
Copy Markdown
Contributor Author

kamilwu commented Aug 12, 2020

Run Load Tests Python CoGBK Dataflow Batch

@kamilwu
Copy link
Copy Markdown
Contributor Author

kamilwu commented Aug 12, 2020

Run Load Tests Python CoGBK Dataflow Streaming

@kamilwu
Copy link
Copy Markdown
Contributor Author

kamilwu commented Aug 12, 2020

R: @kkucharc
cc: @tysonjh

Copy link
Copy Markdown
Contributor

@kkucharc kkucharc left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you a lot @kamilwu for contribution! I added several comments (mainly just to fulfil my curiosity).

Also can you add description to the PR?

Comment thread .test-infra/jenkins/job_LoadTests_coGBK_Python.groovy Outdated
Comment thread .test-infra/jenkins/job_LoadTests_coGBK_Python.groovy Outdated
Comment thread .test-infra/jenkins/job_LoadTests_coGBK_Python.groovy Outdated
@kamilwu kamilwu force-pushed the python-cogbk-streaming branch from 0d8566e to efd8a5d Compare August 18, 2020 08:37
@kamilwu
Copy link
Copy Markdown
Contributor Author

kamilwu commented Aug 18, 2020

Run Seed Job

@kamilwu
Copy link
Copy Markdown
Contributor Author

kamilwu commented Aug 18, 2020

Run Load Tests Python CoGBK Dataflow Streaming

@kamilwu
Copy link
Copy Markdown
Contributor Author

kamilwu commented Aug 18, 2020

Run Load Tests Python CoGBK Dataflow Batch

@kkucharc
Copy link
Copy Markdown
Contributor

This LGTM 💯 Thank you a lot @kamilwu for your contribution

@kamilwu
Copy link
Copy Markdown
Contributor Author

kamilwu commented Aug 20, 2020

Thanks!

@kamilwu kamilwu merged commit 017936f into apache:master Aug 20, 2020
@kamilwu kamilwu deleted the python-cogbk-streaming branch August 20, 2020 14:57
@codecov
Copy link
Copy Markdown

codecov Bot commented Apr 3, 2026

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 0.00%. Comparing base (7219836) to head (efd8a5d).
⚠️ Report is 17743 commits behind head on master.

Additional details and impacted files
@@             Coverage Diff             @@
##           master   #12542       +/-   ##
===========================================
- Coverage   82.50%        0   -82.51%     
===========================================
  Files         453        0      -453     
  Lines       54612        0    -54612     
===========================================
- Hits        45059        0    -45059     
+ Misses       9553        0     -9553     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants