How to install python3 in testing environments

Version 8

Created by martin.luccanera on May 18, 2016 2:54 PM. Last modified by martin.luccanera on May 30, 2016 4:26 PM.

Visibility: Open to anyone

This documents explains how to install Python 3 in an environment with

Python 2.6 pre installed.
CentOS.
Uncertainty about required libraries.

Goal: Being able to execute

cd /usr/local/jive/var/logs/

python3 /adup/tshell/src/sutter.py sbs.log

Steps:

1) Connect to remove server.

ssh root@video-test-5.eng.jiveland.com

Password: Abc123

2) Let's make sure zlib is installed and up to date.

yum makecache fast
yum -y update
yum install zlib

3) Necessary tools.

yum groupinstall -y development

4) More tools.

yum install -y zlib-dev openssl-devel sqlite-devel bzip2-devel

5) Install latest version of python (as of today 18/May/2016 its Python 3.5.1).

wget http://www.python.org/ftp/python/3.5.1/Python-3.5.1.tar.xz --no-check-certificate

6) More tools/libraries.

yum install xz-libs

7) Decompress, compile and install Python 3.

xz -d Python-3.5.1.tar.xz
tar -xvf Python-3.5.1.tar
cd Python-3.5.1
./configure
make && make altinstall

If you receive the "Ignoring ensurepip failure: pip *version* requires SSL/TLS" error:

You should

# sudo yum install openssl-devel

Then repeat

./configure
make && make altinstall

python --version

Check python version. In case this returns other python version than the one we recently installed, we need to create a virtual environment and work with python 3 in that environment.

(We can check python3's version with python3 --version).

If python --version returns Python 3.5.1 skip to step 13.

If python --version returns Python 2.6 or lower you have to install pip via #sudo yum install python-pip

9) Install virtualenv. I'm using python 2's pip to do so.

pip install virtualenv

Alternatively we can access Python3's pip via

cd /usr/local/bin/
./python3.5 pip3.5 install virtualenv

Don't forget the "./" or else it won't work

10) Create a new environment in which we will work with Python3.

virtualenv my_python

Alternatively we can access virtualenv via

cd /usr/local/bin/

./virtualenv my_python

11) Create a virtual environment targeting Python3's binary (if you don't know where it is installed you can use '#whereis python3' or '#which python3').

virtualenv --python=/usr/bin/python3 my_python

12) Activate new environment.

source my_python/bin/activate

Once inside the newly created virtual environment:

13) Install 'requests' which python3 needs in order to execute the final command of our task.

pip install requests

14) Move to designated path.

cd /usr/local/jive/var/logs/

15) Execute final task.

python3 /adup/tshell/src/sutter.py sbs.log

16) Output:

retrieving and processing...done.

deduping ERROR com.jivesoftware.base.event.v2.EventDispatchHelper 1

deduping ERROR com.jivesoftware.cache.impl.KryoSerializer 7

deduping ERROR com.jivesoftware.community.eae.streams.impl.StreamManagerImpl 23

deduping ERROR com.jivesoftware.util.task.TaskEngine 1

deduping ERROR com.jivesoftware.community.impl.DbBlockIterator 3

deduping ERROR com.jivesoftware.community.ext.event.upgrade.AddJiveEventAttendeeUniqueIndexTask 1

deduping ERROR com.jivesoftware.community.eae.impl.ActivityManagerImpl 5

deduping ERROR com.jivesoftware.community.content.event.rest.impl.EventServiceImpl 1

deduping ERROR com.jivesoftware.community.impl.dao.ProfileFieldDAOImpl 7

deduping ERROR com.jivesoftware.community.web.soy.TemplateDependsAnnotationResourceParser 2

deduping ERROR com.jivesoftware.community.app.activity.poll.ActivityPollingManager 66

deduping ERROR com.jivesoftware.extendedApis.util.CompilationProperties 1

deduping ERROR com.jivesoftware.community.upgrade.UpgradeUtils 1

deduping ERROR org.jivesoftware.sqlgen.SQLWriter 5

deduping ERROR com.jivesoftware.base.proxy.ProxyUtils 1

deduping ERROR com.jivesoftware.community.upgrade.tasks.AddDefaultToJiveUserInvitationAcceptanceDateUpgradeTask 1

deduping ERROR com.jivesoftware.base.event.v2.EventDispatchStats 17

deduping ERROR com.jivesoftware.community.antivirus.manager.AntivirusManagerImpl 8

deduping WARN com.jivesoftware.api.core.v2.filters.CoreAPIApplicationStateFilter 1

deduping WARN com.jivesoftware.community.aaa.authz.EntitlementTypeProviderImpl 1

deduping WARN com.jivesoftware.community.web.soy.i18n.bundles.I18nResourceBundler 21

deduping WARN com.jivesoftware.community.web.filter.ApplicationStateFilter 1

deduping WARN com.jivesoftware.community.extension.task.CheckForExtensionUpdatesRunnable 3

deduping WARN com.jivesoftware.community.web.JavascriptCompressor 10

deduping WARN com.jivesoftware.community.web.soy.ResourceGraph 9

deduping WARN com.jivesoftware.community.eae.mail.task.UpdateNotificationRedeliveryTask 1

deduping WARN com.jivesoftware.community.upgrade.tasks.TrueUpColumnsAndIndexesForJive7Task 4

deduping WARN com.jivesoftware.base.database.sequence.MSSQLSequence 7

deduping WARN com.jivesoftware.community.eae.upgrade.tasks.taggedContent.ConcurrencyResources 2

deduping WARN org.openid4java.server.RealmVerifier 4

deduping WARN com.jivesoftware.api.core.v3.providers.metadata.ObjectMetadataProvider 2

deduping WARN com.jivesoftware.community.impl.ProfileFieldManagerImpl 7

deduping WARN com.jivesoftware.community.app.impl.AppRefreshDrainQueueTask 1

deduping WARN com.jivesoftware.community.aaa.JiveAuthenticationTranslationHelper 1

deduping WARN com.jivesoftware.base.taskmanager.impl.TaskQueue 7

deduping WARN com.jivesoftware.spintegration.esp.migrators.SPMigrationTask 1

deduping WARN com.jivesoftware.community.integration.upgrade.PopulateTilePageTableTask 3

deduping WARN com.jivesoftware.community.mobile.push.dao.PushRegistrationDAOImpl 1

deduping WARN org.apache.cxf.jaxrs.utils.ResourceUtils 52

deduping WARN com.jivesoftware.eae.service.client.impl.DefaultServiceClientPool 23

deduping WARN com.jivesoftware.community.eae.upgrade.tasks.taggedContent.EAEUpgradeTaggedContentTask 10

deduping WARN org.apache.cxf.jaxrs.utils.AnnotationUtils 12

deduping WARN com.jivesoftware.eae.service.client.impl.ServiceClientFactory 6

deduping WARN com.jivesoftware.community.extension.impl.ExtensionManagerImpl 2

deduping WARN com.jivesoftware.community.integration.refresh.RefreshDefaultTemplatesAndTiles 3

deduping WARN com.jivesoftware.extendedApis.overlays.OutlookConvertedDiscussionsEmailNotificationFilter 3

deduping WARN com.jivesoftware.base.GroupManagerDelegate 4

deduping WARN com.jivesoftware.extendedApis.artifacts.autoupdate.ArtifactAutoUpdateManagerImpl 2

deduping WARN com.jivesoftware.community.audit.impl.AuditManagerImpl 7

deduping WARN com.jivesoftware.community.upgrade.tasks.MoveMobileHomepageProperties 2

deduping WARN com.jivesoftware.ps.nitro.queue.handler.DeliveryWorkQueueHandler 18

deduping WARN com.jivesoftware.base.event.v2.EventDispatchStats 300

deduping WARN com.jivesoftware.base.event.v2.NonBlockingEventDispatcherImpl 2

deduping INFO com.jivesoftware.community.analytics.upgrade.tasks.ResetDeleteSharesTask 2

deduping INFO com.jivesoftware.community.upgrade.tasks.AddInitialHelpfulAcclaimForHelpfulOutcomesTask 1

deduping INFO com.jivesoftware.extendedApis.im.IMManagerImpl 1

deduping INFO com.jivesoftware.plugin.photo.plugin.PhotoAlbumContentTypePlugin 2

deduping INFO com.jivesoftware.community.lifecycle.JiveApplication 8

deduping INFO com.jivesoftware.community.eae.mail.impl.UpdateNotificationManagerImpl 3

deduping INFO com.jivesoftware.community.news.backend.listeners.PublicationEveryoneStreamHealingTask 6

deduping INFO com.jivesoftware.community.Jive 7

deduping INFO com.jivesoftware.community.web.filter.P3PCompactPolicyFilter 3

deduping INFO com.jivesoftware.community.upgrade.UpgradeManager 219

deduping INFO com.jivesoftware.community.media.video.tasks.PublishedFinishedVideoTask 117

deduping INFO com.jivesoftware.community.web.soy.SoyResourceBundler 20

deduping INFO com.jivesoftware.api.core.v3.providers.metadata.ObjectMetadataProvider 2

deduping INFO com.jivesoftware.community.app.impl.AppRefreshDrainQueueTask 1

deduping INFO com.jivesoftware.extendedApis.extensions.ExtendedApisExtensionAvailabilityProvider 4

deduping INFO com.jivesoftware.community.cloudalytics.impl.CloudalyticsQueuedDispatcher 8

deduping INFO com.jivesoftware.community.analytics.impl.AnalyticsFixInterruptedETLJobsTask 3

deduping INFO com.jivesoftware.community.mail.IncomingMessageValidator 4

deduping INFO com.jivesoftware.community.impl.search.BaseSearchIndexManager 122

deduping INFO com.jivesoftware.community.aaa.JiveDaoAuthenticationProvider 14

deduping INFO com.jivesoftware.community.license.registration.impl.ComponentLicenseRegistration 4

deduping INFO com.jivesoftware.eae.service.client.impl.DefaultCoreServiceClient 5

deduping INFO com.jivesoftware.community.upgrade.UpgradeTaskExecutor 440

deduping INFO com.jivesoftware.community.impl.search.user.ProfileSearchIndexManagerImpl 2

deduping INFO com.jivesoftware.retention.listeners.impl.LoggingListener 1783

deduping INFO net.sf.ehcache.pool.impl.DefaultSizeOfEngine 9

deduping INFO com.jivesoftware.community.upgrade.tasks.AddMissingPermissionLevelsToJivePermLevelTask 1

deduping INFO com.jivesoftware.community.cloudalytics.impl.historical.HistoricalActivityEventManager 2

deduping INFO com.jivesoftware.base.GroupManagerDelegate 8

deduping INFO com.jivesoftware.community.webservices.server.SpringServiceRegistrationListener 3

deduping INFO com.jivesoftware.community.aaa.stateless.JiveSecurityContextValidator 1

deduping INFO com.jivesoftware.base.plugin.PluginSchemaManager 21

deduping INFO com.jivesoftware.community.http.impl.HttpProxySettings 4

deduping INFO com.jivesoftware.community.upgrade.PluginUpgradeManager 20

deduping INFO com.jivesoftware.community.quest.impl.QuestManagerImpl 26

deduping INFO com.jivesoftware.community.aaa.JiveCommunityUserDetailsService 14

deduping INFO com.jivesoftware.community.entitlements.util.ReapplyPermLevelsTask 4

deduping INFO com.jivesoftware.service.client.JiveSingleTenantService 8

deduping INFO com.jivesoftware.community.web.struts.JiveConfigurationManager 3

deduping INFO com.jivesoftware.idea.plugin.IdeaContentTypePlugin 1

deduping INFO com.jivesoftware.community.web.filter.ApplicationStateFilter 3

deduping INFO com.jivesoftware.community.upgrade.tasks.eae.ConvertRecoIDFromVarcharToNVarcharTask 5

deduping INFO com.jivesoftware.community.analytics.AnalyticsPlugin 2

deduping INFO com.jivesoftware.community.valuecase.ValueCaseDefinitionService 2

deduping INFO com.jivesoftware.community.extension.task.CheckForExtensionUpdatesRunnable 2

deduping INFO com.jivesoftware.community.impl.EntitlementManagerImpl 11

deduping INFO com.jivesoftware.community.impl.dao.ProfileFieldDAOImpl 14

deduping INFO com.jivesoftware.community.entitlements.impl.SystemPermissionManagerImpl 6

deduping INFO com.jivesoftware.community.impl.search.ObjectTypePartialIndexRebuildListener 1

deduping INFO com.jivesoftware.community.impl.dao.UserDAODelegate 2

deduping INFO com.jivesoftware.community.impl.DbCommunityManager 11

deduping INFO com.jivesoftware.community.upgrade.tasks.ChangeJiveRenderedContentColumnValueTypeMSSQLTask 4

deduping INFO com.jivesoftware.community.extension.task.TenancyServiceUrlUpdater 6

deduping INFO com.jivesoftware.community.util.SSLConfig 2

deduping INFO com.jivesoftware.community.analytics.upgrade.tasks.ResetIdeasCountsTask 2

deduping INFO com.jivesoftware.base.database.ProxoolDataSource 8

deduping INFO com.jivesoftware.community.upgrade.tasks.NoOpMigrationTask 1

deduping INFO com.jivesoftware.community.upgrade.tasks.AddProfileFldOptPrimaryKeyTask 2

deduping INFO com.jivesoftware.retention.config.impl.InstructionListenerCreatorImpl 5

deduping INFO com.jivesoftware.community.outcome.impl.OutcomeTypeManagerImpl 93

deduping INFO com.jivesoftware.community.impl.CommunityHierarchyHelper 11

deduping INFO com.jivesoftware.community.web.resource.loader.javascript.OpenSocialFileProfile 3

deduping INFO com.jivesoftware.base.event.v2.NonBlockingEventDispatcherImpl 2

deduping INFO com.jivesoftware.eae.service.client.impl.ServiceClientFactory 11

deduping INFO com.jivesoftware.community.project.generateProjectDisplayNamesTask 3

deduping INFO com.jivesoftware.community.browse.impl.BrowseManagerImpl 4

deduping INFO com.jivesoftware.base.database.sequence.MSSQLDefaultSequenceProvider 4

deduping INFO com.jivesoftware.community.integration.storage.members.update.ExStorageMemberEntitlementUpdateNotifier 1

deduping INFO com.jivesoftware.community.aaa.sso.saml.storage.SamlAuthnRequestCleanupTask 3

deduping INFO com.jivesoftware.community.web.soy.impl.SoyTemplateRegistryImpl 9

deduping INFO com.jivesoftware.plugin.catalyst.CatalystPlugin 9

deduping INFO com.jivesoftware.community.web.struts.JiveStrutsExecuteFilter 2

deduping INFO com.jivesoftware.community.analytics.schemas.SchemaBuilder 72

deduping INFO com.jivesoftware.community.upgrade.tasks.Remove0PointSumsFromJiveStatusLevelPntSum 1

deduping INFO com.jivesoftware.api.core.v3.types.CoreObjectTypeProvider 3

deduping INFO com.jivesoftware.community.web.filter.JiveCacheFilter 5

deduping INFO com.jivesoftware.community.mail.outgoing.EmailManagerImpl 16

deduping INFO com.jivesoftware.community.user.profile.ProfileImageCleanupTask 2

deduping INFO com.jivesoftware.community.impl.search.user.solr.BaseSolrRebuildProcessor 2

deduping INFO com.jivesoftware.community.web.filter.JiveStaticFileCacheFilter 4

deduping INFO com.jivesoftware.community.tags.utils.SyncInlineTagsTask 7

deduping DEBUG com.jivesoftware.community.upgrade.tasks.TrueUpColumnsAndIndexesForJive7Task 20

63.88874411582947s

(my_python) [root@video-test-5 logs]#

(my_python) [root@video-test-5 logs]# cd /usr/local/jive/var/logs/

(my_python) [root@video-test-5 logs]# python3 /adup/tshell/src/sutter.py sbs.log