Releases: HEPCloud/decisionengine
HEPCloud decisionengine 2.0.4
Released on 2/28/2025
The full HEPCloud Decision Engine includes decisionengine, the framework, and decisionengine_modules, the standard library for sources, transformation and providers.
Please see the curated release notes on hepcloud.github.io for Notes, Warnings, and more details.
Here are instructions to install and configure Decision Engine.
Fermilab users can access the RPMs also on the production HEPCloud yum repository.
Here are the GitHub-generated notes:
What's Changed
- Introduce publisher status data product by @knoepfel in #668
- changes to fix source logging by @goodenou in #670
- explicitly select a container with all our required python versions by @jcpunk in #671
- Upgrading isort version to fix pre-config install error w/ poetry by @mambelli in #674
- Added EL9 instructions by @mambelli in #676
- Updated and tested instructions, PIP installation working by @mambelli in #678
- Disabling unit tests for python 3.6 by @vitodb in #679
- Make default database init use stronger data protections by @jcpunk in #680
- Update to pytest 7 with pytest-postgresql 5 by @jcpunk in #681
- Updated EL9 instruction: PIP installation and GWMS config tested by @mambelli in #682
- Fix unit tests by @vitodb in #683
- Enable some tests only on DE 1.7 branch by @vitodb in #685
- Update GH actions by @vitodb in #687
- Added two metrics on the Source - de_source_status and de_source_acquire_seconds by @skylerfoster67 in #688
- Adding DE EL9 containers based on AlmaLinux9 by @vitodb in #690
- Adding Jenkinsfile for EL9 by @vitodb in #691
- Added new de-client metrics for duration by @IlyaBaburashvili in #689
- Decision Engine Components Data by @skylerfoster67 in #694
- Redis Exporter Data by @skylerfoster67 in #697
- Re-enable flake8 linter by @vitodb in #696
- Fixed bugs in metrics with labels by @IlyaBaburashvili in #701
- For flake8 skip build folder by @vitodb in #700
- Create Redis mock for unit tests by @shreyb in #703
- In Jenkins pipeline config use podman instead of docker by @vitodb in #706
- add invocation in the child processes for sources/channels logging by @namrathaurs in #710
- Set /metrics Content-type header to text/plain by @shreyb in #713
- Rpm pip packaging with uv and pyproject.toml by @mambelli in #712
- Fixed spec file and added release script by @mambelli in #714
- Added wrapper to run the decisionengine commands also as root. Fixed installation glitches. by @mambelli in #715
- Added a check for the Python code being installed and improved Python code install by @mambelli in #716
- Added codespell in pre-commit and fixed files to compliance by @mambelli in #717
New Contributors
- @skylerfoster67 made their first contribution in #688
- @IlyaBaburashvili made their first contribution in #689
- @namrathaurs made their first contribution in #710
Full Changelog: 2.0.2...2.0.4
Contributors
Assets 2
HEPCloud decisionengine 2.0.2
Released on 9/23/2022
The full HEPCloud Decision Engine includes decisionengine, the framework, and decisionengine_modules, the standard library for sources, transformation and providers.
Please see the curated release notes on hepcloud.github.io for Notes, Warnings, and more details.
Here are instructions to install and configure Decision Engine.
Fermilab users can access the RPMs also on the production HEPCloud yum repository.
Here are the GitHub-generated notes:
What's Changed
- make RPM requires more flexible by @jcpunk in #659
- Add 'Setup pressure-based pilot submission' section to install document by @vitodb in #660
- Set upper limit version for flake8. by @vitodb in #664
- Fixup coverage for new version by @jcpunk in #665
- Added UP/DOWN status metric of the decision engine by @Redjacket45 in #663
- Docker container and test setup for EL8 by @vitodb in #662
- Fixes to docstrings by @BrunoCoimbra in #661
- Add installation instructions for CentOS 8 by @BrunoCoimbra in #658
New Contributors
- @Redjacket45 made their first contribution in #663
Full Changelog: 2.0.1...2.0.2
Contributors
Assets 6
HEPCloud decisionengine 1.7.4
Released on 9/23/2022
The full HEPCloud Decision Engine includes decisionengine, the framework, and decisionengine_modules, the standard library for sources, transformation and providers.
Please see the curated release notes on hepcloud.github.io for Notes, Warnings, and more details.
Here are instructions to install and configure Decision Engine.
Fermilab users can access the RPMs also on the production HEPCloud yum repository.
Here are the GitHub-generated notes:
What's Changed
*No changes, release updated to be in sync with the modules
Full Changelog: 1.7.3...1.7.4
HEPCloud decisionengine 2.0.1
Released on 7/12/2022
The full HEPCloud Decision Engine includes decisionengine, the framework, and decisionengine_modules, the standard library for sources, transformation and providers.
Please see the curated release notes on hepcloud.github.io for Notes, Warnings, and more details.
Here are instructions to install and configure Decision Engine.
Fermilab users can access the RPMs also on the production HEPCloud yum repository.
Here are the GitHub generated notes:
What's Changed
- Update Docker CI entrypoint script by @vitodb in #646
- Fix over-logging of "Taking channel offline" message by @knoepfel in #647
- Fix systemctl stop time delay by @knoepfel in #648
- lock pyupgrade to python3.6 support by @jcpunk in #649
- Fix pre-commit node version to 17.9.0 by @knoepfel in #651
- Lock typing_extensions for Python 3.6 compat by @BrunoCoimbra in #657
- Update GitHub actions; pylint workaround by @knoepfel in #656
- add distinct logging for sources by @goodenou in #654
- Use kombu queues for partial handling of client/server requests by @knoepfel in #655
Full Changelog: 2.0.0...2.0.1
Contributors
Assets 4
HEPCloud decisionengine 1.7.3
Released on 7/12/2022
The full HEPCloud Decision Engine includes decisionengine, the framework, and decisionengine_modules, the standard library for sources, transformation and providers.
Please see the curated release notes on hepcloud.github.io for Notes, Warnings, and more details.
Here are instructions to install and configure Decision Engine.
Fermilab users can access the RPMs also on the production HEPCloud yum repository.
Here are the GitHub generated notes:
What's Changed
*No changes, release updated to be in synch with the modules
Full Changelog: 1.7.2...1.7.3
HEPCloud decisionengine 2.0.0
Released on 4/25/2022 (RC1 on 1/18/2022)
The full HEPCloud Decision Engine includes decisionengine, the framework, and decisionengine_modules, the standard library for sources, transformation, and providers.
Please see the curated release notes on hepcloud.github.io for Notes, Warning and more details.
Here are instructions to install and configure Decision Engine.
Fermilab users can access the RPMs also on the development HEPCloud yum repository.
Here are the GitHub generated notes:
What's Changed
- Support latest setuptools_scm by @jcpunk in #505
- Python optimized byte code removes
assertunder some conditions by @jcpunk in #497 - TaskManager now inherits from ComponentManager. by @bjwhite-fnal in #501
- Fix trailing whitespace in TRUNK by @jcpunk in #513
- Run the code style/standards checks early. by @jcpunk in #510
- Setup black, isort, and pyupgrade by @jcpunk in #444
- Remove now-unnecessary Python-to-Jsonnet conversion by @knoepfel in #516
- Unconditionally execute publishers with default configured logic engine by @knoepfel in #514
- Rework tests for #454 by @jcpunk in #517
- Fix the missing declarations on create_runner and ProcessingState by @jcpunk in #519
- Possible logging simplification by @knoepfel in #515
- Various simplifications recommended by flake8-simple by @jcpunk in #518
- Add channel-combination facilities by @knoepfel in #524
- Further simplify some cases by @jcpunk in #521
- Update hooks to latest via
pre-commit autoupgradeby @jcpunk in #525 - Encourage use of automatic nag hook by @jcpunk in #520
- Improve parameter and variable names by @knoepfel in #527
- Allow channels to boot in parallel by @knoepfel in #532
- Remove unnecessary conversion to Pandas dataframe by @knoepfel in #535
- Start running tests with xdist by @jcpunk in #537
- Fix out of sync devel requirements by @jcpunk in #536
- Incrase coverage in LogicEngine by @jcpunk in #530
- Add error for running server as root by @jcpunk in #534
- Remove now-unnecessary blocking by @knoepfel in #540
- Fix config utilities by @knoepfel in #539
- dummy source and test by @goodenou in #538
- Start testing python 3.10 by @jcpunk in #533
- Automatically format jsonnet files with jsonnetfmt by @jcpunk in #542
- Forbid inheritance from SourceProxy by @knoepfel in #526
- EL7 doesn't ship with a new enough golang for jsonnetfmt by @jcpunk in #543
- Source proxy tests by @knoepfel in #541
- Ignoring E203, whitespace after ':', since black is adding the whitespaces by @mambelli in #545
- Drop testing/support for PyPy by @jcpunk in #548
- Adding a tool to help parsing Decision Engine structured logs by @mambelli in #544
- Cleanups in preparation for Kombu by @knoepfel in #549
- Lower timeout for actions. by @jcpunk in #552
- Lock in specific version of pytest-postgresql. by @jcpunk in #555
- Add instructions for running the Redis container. by @jcpunk in #553
- Add metrics collection to the framework by @shreyb in #523
- Removed unnecessary comment by @shreyb in #559
- Drop obsolete raw postgresql interface by @jcpunk in #558
- Don't try to package obsolete sql file by @jcpunk in #560
- Use kombu to communicate data from sources to cycles by @knoepfel in #556
- Add a redis server to the CI testing containers by @jcpunk in #565
- Do the build of the wheel as not-root per our requirements by @jcpunk in #566
- Added install document and updated instructions by @mambelli in #567
- Changed summaries to histograms in DecisionEngine and TaskManager mod… by @shreyb in #569
- Set state to error for exceptions caught before the thread start. by @jcpunk in #570
- Cleanup before source separation by @knoepfel in #564
- Further flesh out the documentation by @jcpunk in #571
- Report PID for source process by @knoepfel in #574
- Ensure that redis is running by @knoepfel in #573
- Set Apache 2.0 license and added REUSE compliance by @mambelli in #575
- Fix faulty tests by @knoepfel in #578
- Updated developers instructions w/ licensing requirements by @mambelli in #581
- Also run checks on backports to 1.7 by @jcpunk in #579
- addition of queue logging for multiprocessing by @goodenou in #563
- Drop unneeded module by @jcpunk in #583
- Recommend using the site user pip dir instead. by @jcpunk in #584
- Segment the update for setuptools so it gets cached correctly by @jcpunk in #588
- Reduce number of fixtures by @knoepfel in #591
- Ensure de_std.libsonnet is installed by @knoepfel in #593
- Update pre-commit hook versions by @knoepfel in #592
- Use local time for structlog timestamp by @knoepfel in #590
- Use pre-commit.ci rather than local actions by @jcpunk in #594
- [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #595
- Allow duplicate keys if their values are the same by @knoepfel in #589
- Set max retry timeout for sqlite in unit tests. by @jcpunk in #596
- Explicitly pass .coveragerc to pytest. by @jcpunk in #597
- Add some more logging to try and trace startup state by @jcpunk in #598
- Support sources shared between channels by @knoepfel in #568
- More logging about cherrypy state by @jcpunk in #601
- [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #602
- Add a 'ping' method by @jcpunk in #600
- Prep the server fixture to permit the metrics webserver by @jcpunk in #604
- Log finished with DB init by @jcpunk in #605
- Move metrics fixtures to the fixtures file by @jcpunk in #603
- Ensure we are calling the cherrypy shutdown methods by @jcpunk in #606
- Leave note to remember to cleanup temp files by @jcpunk in #607
- cherrypy metrics server blocking startup by @jcpunk in #608
- Pin pytest version by @jcpunk in #609
- Metrics seems to want the channels setup to complete by @jcpunk in #610
- pin jsonnet 0.17.0 by @vitodb in https://github.com/HEPC...
Contributors
Assets 5
HEPCloud decisionengine 1.7.1
Released on 1/25/2022 (RC1 on 1/7/2022)
The full HEPCloud Decision Engine includes decisionengine, the framework, and decisionengine_modules, the standard library for sources, transformation and providers.
Please see the curated release notes on hepcloud.github.io for Notes, Warning and more details.
Here are instructions to install and configure Decision Engine.
Fermilab users can access the RPMs also on the production HEPCloud yum repository.
Here are the GitHub generated notes:
What's Changed
- Fix trailing whitespace in 1.7.0 by @jcpunk in #512
- Porting EmptySource to 1.7 branch by @vitodb in #577
- Also run tests on PRs for backports to 1.7 by @jcpunk in #580
- Porting PR#563 into 1.7 (adding queue logging to de_logger in 1.7 base branch) by @goodenou in #572
- remove unnecessary 'import gc' by @goodenou in #586
- porting "Improve parameter and variable names." to 1.7 branch by @vitodb in #585
Full Changelog: 1.7.0...1.7.1