Skip to content

Conversation

ddevadat
Copy link

@ddevadat ddevadat commented Jun 22, 2023

combining PR 1617,1615,1608,1602

ddevadat and others added 30 commits December 22, 2022 13:16
Signed-off-by: Deepak Devadathan <[email protected]>
Signed-off-by: Deepak Devadathan <[email protected]>
Signed-off-by: Deepak Devadathan <[email protected]>
Signed-off-by: Deepak Devadathan <[email protected]>
Signed-off-by: Deepak Devadathan <[email protected]>
Signed-off-by: Deepak Devadathan <[email protected]>
Signed-off-by: Deepak Devadathan <[email protected]>
In release 4.6.0, Ruby 2.6 is being used. Don't know why in 4.10 / 5.0, Ruby suddenly became 2.2.

In fact, there is NO ruby2.2-dev for bionic. Changing to Ruby 2.6 to proceed
Signed-off-by: Deepak Devadathan <[email protected]>
Signed-off-by: Deepak Devadathan <[email protected]>
Signed-off-by: Deepak Devadathan <[email protected]>
Signed-off-by: Deepak Devadathan <[email protected]>
Signed-off-by: Deepak Devadathan <[email protected]>
Signed-off-by: Deepak Devadathan <[email protected]>
Signed-off-by: Deepak Devadathan <[email protected]>
Signed-off-by: Deepak Devadathan <[email protected]>
ddevadat added 12 commits May 18, 2023 12:21
…JAPACCOE-2839-release-5.1.0-bds-v2

Signed-off-by: Deepak Devadathan <[email protected]>
…JAPACCOE-2858-release-5.1.0

Signed-off-by: Deepak Devadathan <[email protected]>
…github-99-deploy-job-PR

Signed-off-by: Deepak Devadathan <[email protected]>
Ubuntu 22.04 is coming with default python 3.10 version and virtual environment creation is always failing when explicitly virtualenv_python value to pip task in ansible. As per the documentation of ansible(https://docs.ansible.com/ansible/latest/collections/ansible/builtin/pip_module.html),
virtualenv_python : The Python executable used for creating the virtual environment. For example python3.5, python2.7. When not specified, the Python version used to run the ansible module is used.

Signed-off-by: Deepak Devadathan <[email protected]>
@sonarqubecloud
Copy link

Kudos, SonarCloud Quality Gate passed!    Quality Gate passed

Bug A 0 Bugs
Vulnerability A 0 Vulnerabilities
Security Hotspot A 0 Security Hotspots
Code Smell A 0 Code Smells

No Coverage information No Coverage information
No Duplication information No Duplication information

@ddevadat ddevadat changed the title ED-2069: Add OCI oss support superseed PR 1617,1615,1608 ED-2069: Add OCI oss support superseed PR 1617,1615,1608,1602 Jun 22, 2023
@manjudr
Copy link
Collaborator

manjudr commented Aug 3, 2023

I see the previous PR (#1601) changes here as well -
Should we review and merge only this PR? Is both the PR changes are identical or any changes we have here?

Also - I feel this becomes very messy and maintaining the provision script will be very hard.
Maybe we should revise and create an ansible role per cloud storage provider or another format.

ManjunathDavanam

This comment was marked as duplicate.

manjudr
manjudr previously approved these changes Aug 3, 2023
@manjudr manjudr mentioned this pull request Aug 3, 2023
5 tasks
Signed-off-by: Deepak Devadathan <[email protected]>
@sonarqubecloud
Copy link

Kudos, SonarCloud Quality Gate passed!    Quality Gate passed

Bug A 0 Bugs
Vulnerability A 0 Vulnerabilities
Security Hotspot A 0 Security Hotspots
Code Smell A 0 Code Smells

No Coverage information No Coverage information
No Duplication information No Duplication information

warning The version of Java (11.0.8) you have used to run this analysis is deprecated and we will stop accepting it soon. Please update to at least Java 17.
Read more here

@@ -3,7 +3,7 @@ analytics:
soft_path: /mount/data/analytics
base_path: /home/analytics
scala_version: 2.12.10
spark_version: 3.1.3
spark_version: 3.2.1
Copy link
Collaborator

@manjudr manjudr Oct 16, 2023

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@ddevadat - We have tried executing the provision script in our dev environment however, we have encountered some exceptions and couldn't provision the spark to the latest version.
I just wanted to understand did you try provisioning the script successfully to the latest version of the spark(3.2.1) in the OCI environment without making any manual changes?

@santhosh-tg / @tsprasath - Could you please retry running the spark provision script in the dev environment and share the error information here if possible?

cc: @anandp504 @maheshkumargangula @gandham-santhosh @sowmya-dixit

Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Could you please share the exception that you got. One thing that i noted was that at the task: "Download Kafka-2.11" .. the url is hardcoded and not working any more http://downloads.mesosphere.com/kafka/assets/kafka_2.11-0.10.1.0.tgz

if you could share the exception , we can triage it further

Signed-off-by: Deepak Devadathan <[email protected]>
Signed-off-by: Deepak Devadathan <[email protected]>
@sonarqubecloud
Copy link

Kudos, SonarCloud Quality Gate passed!    Quality Gate passed

Bug A 0 Bugs
Vulnerability A 0 Vulnerabilities
Security Hotspot A 0 Security Hotspots
Code Smell A 0 Code Smells

No Coverage information No Coverage information
No Duplication information No Duplication information

warning The version of Java (11.0.8) you have used to run this analysis is deprecated and we will stop accepting it soon. Please update to at least Java 17.
Read more here

@manjudr
Copy link
Collaborator

manjudr commented Oct 17, 2023

@ddevadat - Is this PR updated with the changes we discussed in the call? anything is pending to push?

@ddevadat
Copy link
Author

@ddevadat - Is this PR updated with the changes we discussed in the call? anything is pending to push?

i updated and pushed the changes

@manjudr manjudr merged commit aafe835 into Sunbird-Obsrv:release-5.1.1 Oct 18, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants