OpenShift PIP install broken with Python-2.7 cartridge

[dneyirp]

Hi

I followed instructions from https://developers.openshift.com/languages/python/flask.html
to install a tutorial Flask app. A few days ago all worked but as of yesterday (05 May 2016) it is not working.

When I add "Flask==0.10.1" to "requirements.txt" file, commit and push with git I get the following error:
remote: Collecting Flask==0.10.1 (from -r /var/lib/openshift/57550b1c0c1e666d9400012d/app-root/runtime/repo/requirements.txt (line 1)) remote: The repository located at mirror1.ops.rhcloud.com is not a trusted or secure host and is being ignored. If this repository is available via HTTPS it is recommended to use HTTPS instead, otherwise you may silence this warning and allow it anyways with '--trusted-host mirror1.ops.rhcloud.com'. remote: Could not find a version that satisfies the requirement Flask==0.10.1 (from -r /var/lib/openshift/57550b1c0c1e666d9400012d/app-root/runtime/repo/requirements.txt (line 1)) (from versions: ) remote: No matching distribution found for Flask==0.10.1 (from -r /var/lib/openshift/57550b1c0c1e666d9400012d/app-root/runtime/repo/requirements.txt (line 1))

As mentioned, this worked flawlessly a few days ago.

When I ssh into my app account and run:
pip install Flask --no-cache-dir
there are no problems installing Flask.

If I add Flask==0.10.1 to install_requires in file setup.py. The installation works correctly with no problems.

Can someone help with this problem?

[dneyirp]

Hi

Here is an update.

I have added this line to the top of the requirements.txt file:
--index-url https://pypi.python.org/simple/
which takes me a bit further in that I actually get the Flask package downloaded but the installation fails with this error:
OSError: [Errno 13] Permission denied: '/var/lib/openshift/57550b1c0c1e666d9400012d/.cache'

When I ssh into the app account and check with pip list Flask is still not installed.
I also do not see a .cache folder and neither can I create one.

So far only adding install dependencies to setup.py or ssh'ing and running pip without using the cache dir works.

[dneyirp]

Here is a fix I managed to find using OpenShift actions hooks.
The key web links that helped are listed in the code listing below.

Detailed instructions:

• In your local repo, change to the folder .openshift\action_hooks
• Add a file named build to your local repo folder called .openshift\action_hooks
• In the file build add these lines:

#!/bin/bash

# Written by Priyend Somaroo, 06 Jun 2016, Vardaan Enterpises, www.vardaan.com
#
# This will execute pip install but using no caching in order to fix broken 
# cache problems with python-2.7 cartridge as at 06 Jun 2016
#
#   Ref: http://stackoverflow.com/questions/29913677/openshift-app-with-flask-sqlalchemy-and-sqlite-problems-with-database-reverti
#   Ref: http://stackoverflow.com/questions/21691202/how-to-create-file-execute-mode-permissions-in-git-on-windows
#
# 
# *** Very important *** : this file must be marked executable using 'chmod +x'.
# In Windows this is a problem so we simply mark it in the git repo as executable as follows.
# - In Windows open command prompt and change to the folder with this build file
# - Then run 'git update-index --chmod=+x build'
# - Ten check the permissions aer 0755 using 'git ls-files --stage' .
#
# Normal commits and push's occur after that.

# This build hook gets executed at the end of the build cycle before delpoy

# Change to repo directory and run pip install with no caching
cd ${OPENSHIFT_REPO_DIR}
pip install -r requirements.txt --no-cache-dir

• Mark the build file executable for it to run correctly:
  • In Linux run: chmod +x build
  • For Windows you will need to run this instead: git update-index --chmod=+x build
• Finally complete your git commit and git push

You can confirm the correct packages got installed by ssh'ing into your app folder and running:
pip list

Hopefully this helps someone if they experience the same problems.

Best regards

[nypgand1]

@dneyirp You save my day! Thank you.

[tiwillia]

Interesting, I was not able to reproduce this issue. Adding Flask==0.10.1 to my requirements.txt file and pushing the changes to an application results in a successful deployment.

Is anyone still hitting this issue? If so, are you pushing to openshift.com or running origin-server locally?

[nypgand1]

@tiwillia I can deploy the application actually, but can not import flask at runtime.

[dneyirp]

Hi. Sorry for the late reply. Been super busy.

@nypgand1 Thanks, glad it helped someone else out.

@tiwillia My app is hosted on openshift.redhat.com. All items in the requirements.txt worked perfectly until suddenly on 5 May 2016 is just did not work as mentioned in my post.

Some more info on my experience:
What was noticed is that an existing app that I created prior to 5 May 2016 worked properly, I could add items to requirements.txt and it will pull them through and install correctly but cloning or creating a new project had issues.

I have not checked if it is still broken, I just needed a fix and wrote the post to help others.

[UncleVasya]

Is anyone still hitting this issue?

I do. I have an app on openshift.com with python-2.7 cartridge and dependencies written in requirements.txt.

When I do rhc app-deploy master -a hktools I can see this in output:

...
Collecting dj-database-url==0.3.0 (from -r /var/lib/openshift/576a515089f5cf2f0c000110/app-root/runtime/repo/requirements.txt (line 1))
  The repository located at mirror1.ops.rhcloud.com is not a trusted or secure host and is being ignored. If this repository is available via HTTPS it is recommended to use HTTPS instead, otherwise you may silence this warning and allow it anyways with '--trusted-host mirror1.ops.rhcloud.com'.
  Could not find a version that satisfies the requirement dj-database-url==0.3.0 (from -r /var/lib/openshift/576a515089f5cf2f0c000110/app-root/runtime/repo/requirements.txt (line 1)) (from versions: )
No matching distribution found for dj-database-url==0.3.0 (from -r /var/lib/openshift/576a515089f5cf2f0c000110/app-root/runtime/repo/requirements.txt (line 1))
...

Deploy proceeds and shown as successful:

Preparing build for deployment
Deployment id is a94a9546
Activating deployment
Starting Python 2.7 cartridge (Apache+mod_wsgi)
Application directory "/" selected as DocumentRoot
$OPENSHIFT_PYTHON_WSGI_APPLICATION ENV VAR detected
Application "hackerrank_tools/wsgi.py" selected as default WSGI entry point
Success

But app doesn't work since dependencies weren't installed.

---

Workaround posted above works.

[gdomod]

I got the same problems with pip install. Easy_install works for me from ssh console.

[mikeazo]

I was having the same problem today. The workaround listed above fixed the issue.

[dneyirp]

Just an update.

Tried a new Python-2.7 app yesterday, 24 Oct 2016.
Bug still exists and workaround fixes the problem.

Hopefuly someone at Openshift will be able to get someone to look into it, it seems to be a simple folder permission issue to solve the problem.

[dneyirp]

Hi

From your log a system folder is trying to get removed which is odd. Normally a virtualenv is where installations should occur.

Can you ssh in and run 'pip install Werkzeug' and see if that works?

The work around I posted is to get packages installed using requirements.txt, I can still ssh in and run pip commands and they work.

I can also add packages to setup.py and that works too, maybe you can try it that way and see if it helps.

My work around is basically running the pip installation at the end of the build which then ensures it is run inside the virtual environment.

Something is definitely off with Openshift's system, there does not seem to be a consistency in the way the virtual system works. Their

build system seems to be running the pip installations using requirements.txt before it is inside a virtual environment which then

triggers all sorts of permission problems.

---

From: flowstack notifications@github.com
Sent: Wednesday, October 19, 2016 9:41 PM
To: openshift/origin-server
Cc: dneyirp; Mention
Subject: Re: [openshift/origin-server] OpenShift PIP install broken with Python-2.7 cartridge (#6390)

I am still having this issue. The workaround listed (--no-cache-dir) isn't working for me, regardless of whether the command is run via the build action hook, or in the terminal after SSHing in.

The initial failure was with Werkzeug, which is attempting to write to a folder it doesn't have permission to. I removed it but then another package hit the same issue.

This is causing a problem on a new application I started today, but two other ones created months ago are fine.

Any suggestions?

Exception:
Traceback (most recent call last):
File "/opt/rh/python27/root/usr/lib/python2.7/site-packages/pip/basecommand.py", line 223, in main
status = self.run(options, args)
File "/opt/rh/python27/root/usr/lib/python2.7/site-packages/pip/commands/install.py", line 308, in run
strip_file_prefix=options.strip_file_prefix,
File "/opt/rh/python27/root/usr/lib/python2.7/site-packages/pip/req/req_set.py", line 640, in install
requirement.uninstall(auto_confirm=True)
File "/opt/rh/python27/root/usr/lib/python2.7/site-packages/pip/req/req_install.py", line 726, in uninstall
paths_to_remove.remove(auto_confirm)
File "/opt/rh/python27/root/usr/lib/python2.7/site-packages/pip/req/req_uninstall.py", line 125, in remove
renames(path, new_path)
File "/opt/rh/python27/root/usr/lib/python2.7/site-packages/pip/utils/init.py", line 314, in renames
shutil.move(old, new)
File "/opt/rh/python27/root/usr/lib64/python2.7/shutil.py", line 300, in move
rmtree(src)
File "/opt/rh/python27/root/usr/lib64/python2.7/shutil.py", line 252, in rmtree
onerror(os.remove, fullname, sys.exc_info())
File "/opt/rh/python27/root/usr/lib64/python2.7/shutil.py", line 250, in rmtree
os.remove(fullname)
OSError: [Errno 13] Permission denied: '/opt/rh/python27/root/usr/lib/python2.7/site-packages/Werkzeug-0.8.3-py2.7.egg-info/dependency_links.txt'

You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHubhttps://github.com//issues/6390#issuecomment-254949434, or mute the threadhttps://github.com/notifications/unsubscribe-auth/AM078Fz_jZMc-YrOKss26Q6SBcMjbf1Xks5q1o6mgaJpZM4IuoHA.