Skip to content

Repository audit with new features #30

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 4 commits into
base: main
Choose a base branch
from
Open

Repository audit with new features #30

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
4 commits
Select commit Hold shift + click to select a range
f537e18
Update docker images due to GPG error caused by Nvidia pubkey rotatio…
Nov 24, 2022
1db5196
Update requirements.txt in docker image environment. Update OpenSSL l…
Nov 24, 2022
bc7102e
Degrade Jinja2 and protobuf to old version due to recent Jinja templa…
Nov 24, 2022
38f043a
Add-on feature: enable batch size specification in training job submi…
Nov 24, 2022
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
3 changes: 3 additions & 0 deletions docker/tf_1/Dockerfile
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,6 +1,9 @@
# Base Image
FROM tensorflow/tensorflow:1.15.2-gpu-py3

RUN rm /etc/apt/sources.list.d/cuda.list
RUN rm /etc/apt/sources.list.d/nvidia-ml.list

RUN apt-get update && apt-get -q -y install git-core wget

# Installing the Tensorflow Object Detection API
Expand Down
3 changes: 3 additions & 0 deletions docker/tf_2/Dockerfile
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,6 +1,9 @@
# Base Image
FROM tensorflow/tensorflow:2.6.0-gpu

RUN rm /etc/apt/sources.list.d/cuda.list
RUN rm /etc/apt/sources.list.d/nvidia-ml.list

RUN apt-get update && apt-get -q -y install git-core wget

# Installing the Tensorflow Object Detection API
Expand Down
3 changes: 2 additions & 1 deletion docker/tf_2/requirements.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -13,4 +13,5 @@ Pillow==8.4.0
jellyfish==0.8.2
matplotlib==3.3.4
opencv-python-headless==4.5.3.56
pyparsing==2.4.7
pyparsing==2.4.7
pyOpenSSL==22.0.0
2 changes: 2 additions & 0 deletions src/deployment/conda_env.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -11,5 +11,7 @@ dependencies:
- tensorflow-gpu==1.15
- numpy==1.21.5
- itsdangerous==2.0.1
- Jinja2==3.0.3
- protobuf==3.20.0

name: basic_env
2 changes: 2 additions & 0 deletions src/deployment/conda_env_tf2.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -11,5 +11,7 @@ dependencies:
- tensorflow==2.8.0
- numpy==1.21.5
- itsdangerous==2.0.1
- Jinja2==3.0.3
- protobuf==3.20.0

name: basic_env
1 change: 1 addition & 0 deletions src/training/exp_config_sample.json
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -9,6 +9,7 @@
"IMAGE_TYPE" : "",
"TRAIN_CSV" : "",
"TEST_CSV" : "",
"BATCH_SIZE": 1,
"EVAL_CONF" : 0.5,
"RUN_PARAMS": {
"STEPS": 1000
Expand Down
3 changes: 3 additions & 0 deletions src/training/submit_training.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -43,6 +43,7 @@ def main():
img_type = exp_config['IMAGE_TYPE']
train_csv = exp_config['TRAIN_CSV']
test_csv = exp_config['TEST_CSV']
batch_size = exp_config['BATCH_SIZE']
base_model = (exp_config['MODEL_PARAMS']
['BASE_MODEL'])
steps = (exp_config['RUN_PARAMS']
Expand Down Expand Up @@ -87,6 +88,7 @@ def main():
'--image_type', img_type,
'--train_csv', train_csv,
'--test_csv', test_csv,
'--batch_size', batch_size,
'--base_model', base_model,
'--steps', steps,
'--fs_nms_iou', fs_nms_iou,
Expand All @@ -109,6 +111,7 @@ def main():
'--image_type', img_type,
'--train_csv', train_csv,
'--test_csv', test_csv,
'--batch_size', batch_size,
'--base_model', base_model,
'--steps', steps,
'--eval_conf', eval_conf]
Expand Down