-
Notifications
You must be signed in to change notification settings - Fork 3.7k
[CI][Caffe Frontend] Change the caffe deps into SSD distribution #9060
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
| apt-get install -y --no-install-recommends libboost-filesystem-dev libboost-python-dev \ | ||
| libboost-system-dev libboost-thread-dev libboost-regex-dev protobuf-compiler \ | ||
| libprotobuf-dev libhdf5-serial-dev libopenblas-dev libgflags-dev libgoogle-glog-dev | ||
| rm -rf /var/lib/apt/lists/* |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Why needs this command?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Those packages are the minimum requirement for building caffe from source.
So I put them.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
the rm -rf /var/lib/apt/lists/* part seems a little weird. can you elaborate/link to these instructions?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
That's just a best practice for Dockerfiles.
Best practices for writing Dockerfiles | Docker Documentation
It might be unnecessary for this script. I'll remove it.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
ah, didn't know this but it definitely makes sense. it wasn't the convention we were using before, but we should adopt it. i've filed #9825 to track this.
areusch
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
| apt-get install -y --no-install-recommends libboost-filesystem-dev libboost-python-dev \ | ||
| libboost-system-dev libboost-thread-dev libboost-regex-dev protobuf-compiler \ | ||
| libprotobuf-dev libhdf5-serial-dev libopenblas-dev libgflags-dev libgoogle-glog-dev | ||
| rm -rf /var/lib/apt/lists/* |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
the rm -rf /var/lib/apt/lists/* part seems a little weird. can you elaborate/link to these instructions?
|
|
||
| apt-get install caffe-cpu -y | ||
| # install python packages | ||
| pip install "numpy>=1.7.1" |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
can you add these to python/gen_requirements.py? also, can you use just one pip command to do this?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Ok.
| mkdir /caffe_src/build && cd /caffe_src/build | ||
| cmake .. -DCMAKE_INSTALL_PREFIX=${CAFFE_HOME} -DCMAKE_BUILD_TYPE=Release -DCPU_ONLY=1 \ | ||
| -Dpython_version=3 -DUSE_OPENCV=OFF -DUSE_LEVELDB=OFF -DUSE_LMDB=OFF -DBUILD_docs=OFF -DBLAS=open | ||
| make all -j`nproc` |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
should this $(expr $(nproc) - 1) to avoid overloading systems when running docker/build.sh?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Ok.
areusch
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
thanks @mshr-h and sorry for the delay!
…che#9060) * Change the caffe deps into SSD distribution * update make flag * remove `rm -rf /var/lib/apt/lists/*` * install all python packages in one pip command * install latest package version * add caffe-frontend dependencies
…che#9060) * Change the caffe deps into SSD distribution * update make flag * remove `rm -rf /var/lib/apt/lists/*` * install all python packages in one pip command * install latest package version * add caffe-frontend dependencies
This an update for #6023.
@fernchen @zhiics @tqchen @FrozenGene
Can you take a look at this PR, please? Thanks!