Skip to content
This repository has been archived by the owner on Dec 4, 2024. It is now read-only.

MWT-27 #581

Open
wants to merge 67 commits into
base: master
Choose a base branch
from
Open

MWT-27 #581

wants to merge 67 commits into from

Conversation

rishabh96b
Copy link
Contributor

Changes for upcoming MWT-27

mpereira and others added 30 commits April 15, 2020 16:50
@mpereira @rishabh96b
Add visual separations for the script's sections.
ef3c10d
@mpereira @rishabh96b
Make container name be dependent on test parameter file name.
70579ca
@mpereira @rishabh96b
Check package repos every time, create Marathon group.
9564118
@mpereira @rishabh96b
Use container name for docker image tag and run directory.
287a9b9
@mpereira @rishabh96b
Automatically format some files with Black.
04717bd
@mpereira @rishabh96b
Parameterize group file name, run commands in container.
9fbca5b
@mpereira @rishabh96b
Run commands in the container.
0e856a2
@mpereira @rishabh96b
Quote this.
d9a7e96
@mpereira @rishabh96b
Make deploy-dispatchers.py script support group roles.
585beac
@mpereira @rishabh96b
Show CLUSTER_URL in pre-run report.
c4d870f
@mpereira @rishabh96b
Add group_role support to streaming workload deploy script.
cd95b27
@mpereira @rishabh96b
Make sure service name is prefixed with a slash.
5c1c912
@mpereira @rishabh96b
Add group_role support to the batch_test.py script.
f40351a
@mpereira @rishabh96b
Add required roles and permissions required for group role enforcement.
0b25ba5
@mpereira @rishabh96b
Add spark-options.json file.
0a2f2d1
@mpereira @samvantran @rishabh96b
Typo.
2bd9407 
Co-Authored-By: Sam Tran <[email protected]>
@mpereira @samvantran @rishabh96b
Add CLI parameter description.
73b5824 
Co-Authored-By: Sam Tran <[email protected]>
@mpereira @rishabh96b
Remove failing jobs stuff.
bf0fcf0
@mpereira @rishabh96b
Fix shellcheck warning.
0025ef4
@mpereira @rishabh96b
Variable renames, shellcheck fixes, DSEngine, total cpu/mem/gpu.
50b56ef
@mpereira @rishabh96b
GROUP_NAME should be coming with no slash prefix.
b849f5d
@mpereira @rishabh96b
Create quota if it doesn't exit.
2f1075b
@mpereira @rishabh96b
Install recent DC/OS CLI.
222cbe2
@mpereira @rishabh96b
Fix quoting.
464a17b
@mpereira @rishabh96b
Should be group name here.
af9129e
@mpereira @rishabh96b
Make revoke_permissions() also take role list.
c2daf5e
@mpereira @rishabh96b
Fix indentation.
65b3fd9
@mpereira @rishabh96b
Make DC/OS CLI binary a parameter.
bec6c9f
@mpereira @rishabh96b
Don't break out of loop, just skip to the next element.
5b34f05
@mpereira @rishabh96b
This was breaking.
3cd62ec
alexeygorobets and others added 19 commits September 14, 2020 17:04
@alexeygorobets
update Cassandra to 2.10.0-3.11.6-beta
ba74e60
@alexeygorobets
add external volumes to cassandra options
05743fa
@rishabh96b
use latest spark 2.11.0-2.4.6
610e6a3
@rishabh96b
update spark stub to universe-converter
6888ecc
@alexeygorobets
Merge branch 'dcos-58437-deploy-workloads-under-role-enforced-group' …
3a4b36e 
…into mwt-26

# Conflicts:
#	spark-testing/spark_utils.py
#	testing/sdk_install.py
@farhan5900
Adds data science engine configs
6ffb082
@alexeygorobets
update configs for dry run
288b97a
@alexeygorobets
use root user for services
853dbe5
@alexeygorobets
Merge remote-tracking branch 'origin/mwt-26' into mwt-26
f087a33 
# Conflicts:
#	scale-tests/configs/dsengine-options.json
#	scale-tests/run.sh
@kaiwalyajoshi
Grant task:user:root permissions on master and agent for DSE.
c8e8fdc
@alexeygorobets
install DSE with other services
7d85cbb
@alexeygorobets
update dsengine options
8b71331
@alexeygorobets
Merge branch 'mwt-26' of https://github.com/mesosphere/spark-build in…
a8c6e56 
…to mwt-26
@alexeygorobets
fix DSE permissions
083ebb9
@alexeygorobets
add MWT 26 config
2750a25
@alexeygorobets
not using GPU in DSE
6032efa
@alexeygorobets
fix marathon check for batched job
aaace06
@alexeygorobets
use right branch in batched workload for spark
d34af99
@rishabh96b
add configs for mwt-27
20d3f85
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Reviewers

@kaiwalyajoshi kaiwalyajoshi kaiwalyajoshi approved these changes

@farhan5900 farhan5900 Awaiting requested review from farhan5900

@alexeygorobets alexeygorobets Awaiting requested review from alexeygorobets

Assignees
No one assigned
Labels
MWT-27
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
5 participants
@rishabh96b @kaiwalyajoshi @mpereira @alexeygorobets @farhan5900