AWS SDK for PHPでのslab増大とNSS_SDB_USE_CACHE対策の効果確認

色々調べると、GuzzleHttpがHTTPSで通信する際に増えるらしい

まとめ

AWS SDKのクライアント、GuzzleHttpも最終的にphpのcurl_～関数を呼んでいる
※constructorでcurlが無い場合、Exception吐くコードがあるし、AWSの要件にもcurlが入っている
php curl の nssは多分、ビルドされたcurlのNSSバージョンに依存してそう
※curl -V のNSS/3.27 の部分
curlをmakeすると、その時のOSのnssバージョンが組み込まれた
curl 7.19.7 (x86_64-unknown-linux-gnu) libcurl/7.19.7 NSS/3.36
かつ、その際、nss-softokn-3.14.3-23.3.el6_8.x86_64 で、curlコマンドのNSS_SDB_USE_CACHE=yes は有効だった
phpのcurlバージョンは、コマンドと同じくlibcurlに依存してそうだが、curl_version(); 又は、phpinfo(); で確認できる

各種情報

[root@ip-172-31-16-82 centos]# cat /etc/redhat-release
CentOS release 6.9 (Final)
[root@ip-172-31-16-82 centos]# rpm -qa | grep nss-softokn
nss-softokn-freebl-3.14.3-23.3.el6_8.x86_64
nss-softokn-3.14.3-23.3.el6_8.x86_64
[root@ip-172-31-16-82 centos]# php -v
PHP 5.5.38 (cli) (built: Mar  1 2018 11:12:35)
Copyright (c) 1997-2015 The PHP Group
Zend Engine v2.5.0, Copyright (c) 1998-2015 Zend Technologies


[centos@ip-172-31-16-82 slab-nss]$ cat composer.json
{
    "require": {
        "aws/aws-sdk-php": "^2.8"
    }
}

[root@ip-172-31-16-82 centos]# cat /etc/redhat-release

CentOS release 6.9 (Final)

[root@ip-172-31-16-82 centos]# rpm -qa | grep nss-softokn

nss-softokn-freebl-3.14.3-23.3.el6_8.x86_64

nss-softokn-3.14.3-23.3.el6_8.x86_64

[root@ip-172-31-16-82 centos]# php -v

PHP 5.5.38 (cli) (built: Mar 1 2018 11:12:35)

[centos@ip-172-31-16-82 slab-nss]$ cat composer.json

{

"require": {

"aws/aws-sdk-php": "^2.8"

}

AWS-SDKでSNSへpublishするテストコードを準備

<?php

require_once('./vendor/autoload.php');
use Aws\Sns\SnsClient;

$arn = "arn:aws:sns:ap-northeast-1:xxxxxx:aws-sdk-nss-dentry-test";
$message = 'dummy message';

$client = SnsClient::factory(array(
    'profile' => 'default',
    'region'  => 'ap-northeast-1',
));

for ($i = 0; $i < 100; $i ++) {
    $result = $client->publish(array(
        'TopicArn' => $arn,
        'Message' => $message
    ));
}

<?php

require_once('./vendor/autoload.php');

use Aws\Sns\SnsClient;

$arn = "arn:aws:sns:ap-northeast-1:xxxxxx:aws-sdk-nss-dentry-test";

$message = 'dummy message';

$client = SnsClient::factory(array(

'profile' => 'default',

'region' => 'ap-northeast-1',

));

for ($i = 0; $i < 100; $i ++) {

$result = $client->publish(array(

'TopicArn' => $arn,

'Message' => $message

));

}

実行前後の情報

[centos@ip-172-31-16-82 ~]$ sar -v 0
Linux 2.6.32-696.30.1.el6.x86_64 (ip-172-31-16-82.ap-northeast-1.compute.internal)      07/08/2018      _x86_64_        (1 CPU)

07:51:10 AM dentunusd   file-nr  inode-nr    pty-nr
07:51:10 AM     41344       736      7227         5
[centos@ip-172-31-16-82 ~]$ sar -v 0
Linux 2.6.32-696.30.1.el6.x86_64 (ip-172-31-16-82.ap-northeast-1.compute.internal)      07/08/2018      _x86_64_        (1 CPU)

07:51:33 AM dentunusd   file-nr  inode-nr    pty-nr
07:51:33 AM     61344       736      7227         5

[centos@ip-172-31-16-82 ~]$ slabtop -o | grep dentry
 48140  48105  99%    0.19K   2407       20      9628K dentry
[centos@ip-172-31-16-82 ~]$ slabtop -o | grep dentry
 68100  68100 100%    0.19K   3405       20     13620K dentry

[centos@ip-172-31-16-82 ~]$ free
             total       used       free     shared    buffers     cached
Mem:        499996     174200     325796        160      14212      53744
-/+ buffers/cache:     106244     393752
Swap:      1048572       1280    1047292
[centos@ip-172-31-16-82 ~]$ free
             total       used       free     shared    buffers     cached
Mem:        499996     178176     321820        160      14220      53744
-/+ buffers/cache:     110212     389784
Swap:      1048572       1280    1047292

[centos@ip-172-31-16-82 ~]$ sar -v 0

Linux 2.6.32-696.30.1.el6.x86_64 (ip-172-31-16-82.ap-northeast-1.compute.internal) 07/08/2018 _x86_64_ (1 CPU)

07:51:10 AM dentunusd file-nr inode-nr pty-nr

07:51:10 AM 41344 736 7227 5

[centos@ip-172-31-16-82 ~]$ sar -v 0

Linux 2.6.32-696.30.1.el6.x86_64 (ip-172-31-16-82.ap-northeast-1.compute.internal) 07/08/2018 _x86_64_ (1 CPU)

07:51:33 AM dentunusd file-nr inode-nr pty-nr

07:51:33 AM 61344 736 7227 5

[centos@ip-172-31-16-82 ~]$ slabtop -o | grep dentry

48140 48105 99% 0.19K 2407 20 9628K dentry

[centos@ip-172-31-16-82 ~]$ slabtop -o | grep dentry

68100 68100 100% 0.19K 3405 20 13620K dentry

[centos@ip-172-31-16-82 ~]$ free

total used free shared buffers cached

Mem: 499996 174200 325796 160 14212 53744

-/+ buffers/cache: 106244 393752

Swap: 1048572 1280 1047292

[centos@ip-172-31-16-82 ~]$ free

total used free shared buffers cached

Mem: 499996 178176 321820 160 14220 53744

-/+ buffers/cache: 110212 389784

Swap: 1048572 1280 1047292

dentunusedが増加し、dentryのslabが増加している。

buffers/cacheが減少している。

対策コードを追加

<?php
putenv("NSS_SDB_USE_CACHE=yes"); // ★追加

require_once('./vendor/autoload.php');
use Aws\Sns\SnsClient;

$arn = "arn:aws:sns:ap-northeast-1:xxxxxx:aws-sdk-nss-dentry-test";
$message = 'dummy message';

$client = SnsClient::factory(array(
    'profile' => 'default',
    'region'  => 'ap-northeast-1',
));

for ($i = 0; $i < 100; $i ++) {
    $result = $client->publish(array(
        'TopicArn' => $arn,
        'Message' => $message
    ));
}

<?php

putenv("NSS_SDB_USE_CACHE=yes"); // ★追加

require_once('./vendor/autoload.php');

use Aws\Sns\SnsClient;

$arn = "arn:aws:sns:ap-northeast-1:xxxxxx:aws-sdk-nss-dentry-test";

$message = 'dummy message';

$client = SnsClient::factory(array(

'profile' => 'default',

'region' => 'ap-northeast-1',

));

for ($i = 0; $i < 100; $i ++) {

$result = $client->publish(array(

'TopicArn' => $arn,

'Message' => $message

));

}

実行前後の情報

[centos@ip-172-31-16-82 ~]$ sar -v 0
Linux 2.6.32-696.30.1.el6.x86_64 (ip-172-31-16-82.ap-northeast-1.compute.internal)      07/08/2018      _x86_64_        (1 CPU)

07:55:05 AM dentunusd   file-nr  inode-nr    pty-nr
07:55:05 AM     61349       736      7230         5
[centos@ip-172-31-16-82 ~]$ sar -v 0
Linux 2.6.32-696.30.1.el6.x86_64 (ip-172-31-16-82.ap-northeast-1.compute.internal)      07/08/2018      _x86_64_        (1 CPU)

07:55:15 AM dentunusd   file-nr  inode-nr    pty-nr
07:55:15 AM     61349       736      7230         5

[centos@ip-172-31-16-82 ~]$ slabtop -o | grep dentry
 68120  68110  99%    0.19K   3406       20     13624K dentry
[centos@ip-172-31-16-82 ~]$ slabtop -o | grep dentry
 68160  68136  99%    0.19K   3408       20     13632K dentry

[centos@ip-172-31-16-82 ~]$ free
             total       used       free     shared    buffers     cached
Mem:        499996     178300     321696        160      14292      53844
-/+ buffers/cache:     110164     389832
Swap:      1048572       1280    1047292
[centos@ip-172-31-16-82 ~]$ free
             total       used       free     shared    buffers     cached
Mem:        499996     178300     321696        160      14300      53844
-/+ buffers/cache:     110156     389840
Swap:      1048572       1280    1047292

[centos@ip-172-31-16-82 ~]$ sar -v 0

Linux 2.6.32-696.30.1.el6.x86_64 (ip-172-31-16-82.ap-northeast-1.compute.internal) 07/08/2018 _x86_64_ (1 CPU)

07:55:05 AM dentunusd file-nr inode-nr pty-nr

07:55:05 AM 61349 736 7230 5

[centos@ip-172-31-16-82 ~]$ sar -v 0

Linux 2.6.32-696.30.1.el6.x86_64 (ip-172-31-16-82.ap-northeast-1.compute.internal) 07/08/2018 _x86_64_ (1 CPU)

07:55:15 AM dentunusd file-nr inode-nr pty-nr

07:55:15 AM 61349 736 7230 5

[centos@ip-172-31-16-82 ~]$ slabtop -o | grep dentry

68120 68110 99% 0.19K 3406 20 13624K dentry

[centos@ip-172-31-16-82 ~]$ slabtop -o | grep dentry

68160 68136 99% 0.19K 3408 20 13632K dentry

[centos@ip-172-31-16-82 ~]$ free

total used free shared buffers cached

Mem: 499996 178300 321696 160 14292 53844

-/+ buffers/cache: 110164 389832

Swap: 1048572 1280 1047292

[centos@ip-172-31-16-82 ~]$ free

total used free shared buffers cached

Mem: 499996 178300 321696 160 14300 53844

-/+ buffers/cache: 110156 389840

Swap: 1048572 1280 1047292

ほぼ増加しなくなったことがわかる。

nss-softokn-3.14.3-23.3.el6_8 の環境でも効果がありそうだ。

GuzzleHttp

コードを追っていくと、内部でphp curlを使っているようだ

if (!extension_loaded('curl')) {
    // @codeCoverageIgnoreStart
    throw new RuntimeException('The PHP cURL extension must be installed to use Guzzle.');
    // @codeCoverageIgnoreEnd
}

if (!extension_loaded('curl')) {

// @codeCoverageIgnoreStart

throw new RuntimeException('The PHP cURL extension must be installed to use Guzzle.');

// @codeCoverageIgnoreEnd

}

curl と nss

[centos@ip-172-31-16-82 slab-nss]$ php -r "phpinfo();" | grep "^curl" -A24
PHP Warning:  phpinfo(): It is not safe to rely on the system's timezone settings. You are *required* to use the date.timezone setting or the date_default_timezone_set() function. In case you used any of those methods and you are still getting this warning, you most likely misspelled the timezone identifier. We selected the timezone 'UTC' for now, but please set date.timezone to select your timezone. in Command line code on line 1
curl

cURL support => enabled
cURL Information => 7.19.7
Age => 3
Features
AsynchDNS => No
CharConv => No
Debug => No
GSS-Negotiate => Yes
IDN => Yes
IPv6 => Yes
krb4 => No
Largefile => Yes
libz => Yes
NTLM => Yes
SPNEGO => No
SSL => Yes
SSPI => No
Protocols => tftp, ftp, telnet, dict, ldap, ldaps, http, file, https, ftps, scp, sftp
Host => x86_64-redhat-linux-gnu
SSL Version => NSS/3.27.1
ZLib Version => 1.2.3
libSSH Version => libssh2/1.4.2

[centos@ip-172-31-16-82 slab-nss]$ php -r "phpinfo();" | grep "^curl" -A24

PHP Warning: phpinfo(): It is not safe to rely on the system's timezone settings. You are *required* to use the date.timezone setting or the date_default_timezone_set() function. In case you used any of those methods and you are still getting this warning, you most likely misspelled the timezone identifier. We selected the timezone 'UTC' for now, but please set date.timezone to select your timezone. in Command line code on line 1

curl

cURL support => enabled

cURL Information => 7.19.7

Age => 3

Features

AsynchDNS => No

CharConv => No

Debug => No

GSS-Negotiate => Yes

IDN => Yes

IPv6 => Yes

krb4 => No

Largefile => Yes

libz => Yes

NTLM => Yes

SPNEGO => No

SSL => Yes

SSPI => No

Protocols => tftp, ftp, telnet, dict, ldap, ldaps, http, file, https, ftps, scp, sftp

Host => x86_64-redhat-linux-gnu

SSL Version => NSS/3.27.1

ZLib Version => 1.2.3

libSSH Version => libssh2/1.4.2

[centos@ip-172-31-16-82 slab-nss]$ php -r "print_r(curl_version());"
Array
(
    [version_number] => 463623
    [age] => 3
    [features] => 1597
    [ssl_version_number] => 0
    [version] => 7.19.7
    [host] => x86_64-redhat-linux-gnu
    [ssl_version] => NSS/3.27.1
    [libz_version] => 1.2.3
    [protocols] => Array
        (
            [0] => tftp
            [1] => ftp
            [2] => telnet
            [3] => dict
            [4] => ldap
            [5] => ldaps
            [6] => http
            [7] => file
            [8] => https
            [9] => ftps
            [10] => scp
            [11] => sftp
        )

)

[centos@ip-172-31-16-82 slab-nss]$ php -r "print_r(curl_version());"

Array

(

[version_number] => 463623

[age] => 3

[features] => 1597

[ssl_version_number] => 0

[version] => 7.19.7

[host] => x86_64-redhat-linux-gnu

[ssl_version] => NSS/3.27.1

[libz_version] => 1.2.3

[protocols] => Array

(

[0] => tftp

[1] => ftp

[2] => telnet

[3] => dict

[4] => ldap

[5] => ldaps

[6] => http

[7] => file

[8] => https

[9] => ftps

[10] => scp

[11] => sftp

)

NSS/3.27.1 が使われているようだ。

osにinstallされているnss-softknは使われていない？

curlをmakeして確かめてみる

同じバージョンをインストール

#  cd /usr/local/src/
#  curl -O https://curl.haxx.se/download/archeology/curl-7.19.7.tar.gz
#  tar xvzf curl-7.19.7.tar.gz
#  cd curl-7.19.7

#  yum install gcc g++
#  yum install nspr-devel
#  yum install nss-devel

#  ./configure --with-nss --disable-manual
#  make

# cd /usr/local/src/

# curl -O https://curl.haxx.se/download/archeology/curl-7.19.7.tar.gz

# tar xvzf curl-7.19.7.tar.gz

# cd curl-7.19.7

# yum install gcc g++

# yum install nspr-devel

# yum install nss-devel

# ./configure --with-nss --disable-manual

# make

システムのnssが使われた事の確認と効果の確認

[root@ip-172-31-16-82 curl-7.19.7]# rpm -qa | grep nss
nss-softokn-freebl-3.14.3-23.3.el6_8.x86_64
nss-util-3.36.0-1.el6.x86_64
nss-softokn-freebl-devel-3.14.3-23.3.el6_8.x86_64
nss-sysinit-3.36.0-8.el6.x86_64
nss-devel-3.36.0-8.el6.x86_64
openssh-server-5.3p1-123.el6_9.x86_64
nss-util-devel-3.36.0-1.el6.x86_64
nss-softokn-devel-3.14.3-23.3.el6_8.x86_64
nss-3.36.0-8.el6.x86_64
nss-tools-3.36.0-8.el6.x86_64
nss-softokn-3.14.3-23.3.el6_8.x86_64
openssl-1.0.1e-57.el6.x86_64
openssh-5.3p1-123.el6_9.x86_64
openssh-clients-5.3p1-123.el6_9.x86_64

[root@ip-172-31-16-82 curl-7.19.7]# ./src/curl -V
curl 7.19.7 (x86_64-unknown-linux-gnu) libcurl/7.19.7 NSS/3.36
Protocols: tftp ftp telnet dict http file https ftps
Features: IPv6 Largefile SSL

[root@ip-172-31-16-82 curl-7.19.7]# strace -fc -e trace=access ./src/curl  -s https://www.google.co.jp/ > /dev/null
Process 28940 attached
Process 28941 attached
Process 28942 attached
Process 28943 attached
Process 28944 attached
Process 28946 attached
Process 28945 attached
Process 28947 attached
Process 28949 attached
Process 28948 attached
Process 28950 attached
Process 28951 attached
Process 28953 attached
Process 28952 attached
% time     seconds  usecs/call     calls    errors syscall
------ ----------- ----------- --------- --------- ----------------
  0.00    0.000000           0       938       926 access
------ ----------- ----------- --------- --------- ----------------
100.00    0.000000                   938       926 total
[root@ip-172-31-16-82 curl-7.19.7]# NSS_SDB_USE_CACHE=yes strace -fc -e trace=access ./src/curl  -s https://www.google.co.jp/ > /dev/null
Process 29010 attached
Process 29011 attached
Process 29012 attached
Process 29014 attached
Process 29015 attached
Process 29017 attached
Process 29016 attached
Process 29018 attached
Process 29020 attached
Process 29019 attached
Process 29021 attached
Process 29022 attached
Process 29024 attached
Process 29023 attached
% time     seconds  usecs/call     calls    errors syscall
------ ----------- ----------- --------- --------- ----------------
  0.00    0.000000           0        24        12 access
------ ----------- ----------- --------- --------- ----------------
100.00    0.000000                    24        12 total

[root@ip-172-31-16-82 curl-7.19.7]# rpm -qa | grep nss

nss-softokn-freebl-3.14.3-23.3.el6_8.x86_64

nss-util-3.36.0-1.el6.x86_64

nss-softokn-freebl-devel-3.14.3-23.3.el6_8.x86_64

nss-sysinit-3.36.0-8.el6.x86_64

nss-devel-3.36.0-8.el6.x86_64

openssh-server-5.3p1-123.el6_9.x86_64

nss-util-devel-3.36.0-1.el6.x86_64

nss-softokn-devel-3.14.3-23.3.el6_8.x86_64

nss-3.36.0-8.el6.x86_64

nss-tools-3.36.0-8.el6.x86_64

nss-softokn-3.14.3-23.3.el6_8.x86_64

openssl-1.0.1e-57.el6.x86_64

openssh-5.3p1-123.el6_9.x86_64

openssh-clients-5.3p1-123.el6_9.x86_64

[root@ip-172-31-16-82 curl-7.19.7]# ./src/curl -V

curl 7.19.7 (x86_64-unknown-linux-gnu) libcurl/7.19.7 NSS/3.36

Protocols: tftp ftp telnet dict http file https ftps

Features: IPv6 Largefile SSL

[root@ip-172-31-16-82 curl-7.19.7]# strace -fc -e trace=access ./src/curl -s https://www.google.co.jp/ > /dev/null

Process 28940 attached

Process 28941 attached

Process 28942 attached

Process 28943 attached

Process 28944 attached

Process 28946 attached

Process 28945 attached

Process 28947 attached

Process 28949 attached

Process 28948 attached

Process 28950 attached

Process 28951 attached

Process 28953 attached

Process 28952 attached

% time seconds usecs/call calls errors syscall

------ ----------- ----------- --------- --------- ----------------

0.00 0.000000 0 938 926 access

------ ----------- ----------- --------- --------- ----------------

100.00 0.000000 938 926 total

[root@ip-172-31-16-82 curl-7.19.7]# NSS_SDB_USE_CACHE=yes strace -fc -e trace=access ./src/curl -s https://www.google.co.jp/ > /dev/null

Process 29010 attached

Process 29011 attached

Process 29012 attached

Process 29014 attached

Process 29015 attached

Process 29017 attached

Process 29016 attached

Process 29018 attached

Process 29020 attached

Process 29019 attached

Process 29021 attached

Process 29022 attached

Process 29024 attached

Process 29023 attached

% time seconds usecs/call calls errors syscall

------ ----------- ----------- --------- --------- ----------------

0.00 0.000000 0 24 12 access

------ ----------- ----------- --------- --------- ----------------

100.00 0.000000 24 12 total

nss-softokn-3.14.3-23.3 で nss-softokn-3.14.3-23.3 が使えているだろうと思われる。

CentOS6.6 に wget, epel, pip, aws cli のインストール

コメントを残す

wget

[centos@ip-172-31-16-82 slab-nss]$ sudo yum install wget
Loaded plugins: fastestmirror, presto
Setting up Install Process
Loading mirror speeds from cached hostfile
 * base: ftp.iij.ad.jp
 * extras: ftp.iij.ad.jp
 * updates: ftp.iij.ad.jp
Resolving Dependencies
--> Running transaction check
---> Package wget.x86_64 0:1.12-10.el6 will be installed
--> Finished Dependency Resolution

Dependencies Resolved

================================================================================================================================================================================================================
 Package                                         Arch                                              Version                                                Repository                                       Size
================================================================================================================================================================================================================
Installing:
 wget                                            x86_64                                            1.12-10.el6                                            base                                            484 k

Transaction Summary
================================================================================================================================================================================================================
Install       1 Package(s)

[centos@ip-172-31-16-82 slab-nss]$ sudo yum install wget

Loaded plugins: fastestmirror, presto

Setting up Install Process

Loading mirror speeds from cached hostfile

* base: ftp.iij.ad.jp

* extras: ftp.iij.ad.jp

* updates: ftp.iij.ad.jp

Resolving Dependencies

--> Running transaction check

---> Package wget.x86_64 0:1.12-10.el6 will be installed

--> Finished Dependency Resolution

Dependencies Resolved

================================================================================================================================================================================================================

Package Arch Version Repository Size

Installing:

wget x86_64 1.12-10.el6 base 484 k

Transaction Summary

Install 1 Package(s)

epel

[centos@ip-172-31-16-82 slab-nss]$ wget http://ftp.riken.jp/Linux/fedora/epel/6/x86_64/Packages/e/epel-release-6-8.noarch.rpm
--2018-07-07 08:34:08--  http://ftp.riken.jp/Linux/fedora/epel/6/x86_64/Packages/e/epel-release-6-8.noarch.rpm
Resolving ftp.riken.jp... 134.160.38.1
Connecting to ftp.riken.jp|134.160.38.1|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 14540 (14K) [application/x-rpm]
Saving to: “epel-release-6-8.noarch.rpm”

100%[======================================================================================================================================================================>] 14,540      --.-K/s   in 0.006s

2018-07-07 08:34:08 (2.30 MB/s) - “epel-release-6-8.noarch.rpm” saved [14540/14540]

[centos@ip-172-31-16-82 slab-nss]$ sudo rpm -ivh ./epel-release-6-8.noarch.rpm
warning: ./epel-release-6-8.noarch.rpm: Header V3 RSA/SHA256 Signature, key ID 0608b895: NOKEY
Preparing...                ########################################### [100%]
   1:epel-release           ########################################### [100%]

[centos@ip-172-31-16-82 slab-nss]$ wget http://ftp.riken.jp/Linux/fedora/epel/6/x86_64/Packages/e/epel-release-6-8.noarch.rpm

--2018-07-07 08:34:08-- http://ftp.riken.jp/Linux/fedora/epel/6/x86_64/Packages/e/epel-release-6-8.noarch.rpm

Resolving ftp.riken.jp... 134.160.38.1

Connecting to ftp.riken.jp|134.160.38.1|:80... connected.

HTTP request sent, awaiting response... 200 OK

Length: 14540 (14K) [application/x-rpm]

Saving to: “epel-release-6-8.noarch.rpm”

100%[======================================================================================================================================================================>] 14,540 --.-K/s in 0.006s

2018-07-07 08:34:08 (2.30 MB/s) - “epel-release-6-8.noarch.rpm” saved [14540/14540]

[centos@ip-172-31-16-82 slab-nss]$ sudo rpm -ivh ./epel-release-6-8.noarch.rpm

warning: ./epel-release-6-8.noarch.rpm: Header V3 RSA/SHA256 Signature, key ID 0608b895: NOKEY

Preparing... ########################################### [100%]

1:epel-release ########################################### [100%]

CentOS : EPEL リポジトリ追加

php5.5を入れるために

[centos@ip-172-31-16-82 slab-nss]$ sudo rpm -Uvh http://rpms.famillecollet.com/enterprise/remi-release-6.rpm
Retrieving http://rpms.famillecollet.com/enterprise/remi-release-6.rpm
warning: /var/tmp/rpm-tmp.9t2Bg0: Header V4 DSA/SHA1 Signature, key ID 00f97f56: NOKEY
Preparing...                ########################################### [100%]
   1:remi-release           ########################################### [100%]

[centos@ip-172-31-16-82 slab-nss]$ sudo rpm -Uvh http://rpms.famillecollet.com/enterprise/remi-release-6.rpm

Retrieving http://rpms.famillecollet.com/enterprise/remi-release-6.rpm

warning: /var/tmp/rpm-tmp.9t2Bg0: Header V4 DSA/SHA1 Signature, key ID 00f97f56: NOKEY

Preparing... ########################################### [100%]

1:remi-release ########################################### [100%]

pip

[centos@ip-172-31-16-82 slab-nss]$ sudo yum install --enablerepo=epel python-pip
Loaded plugins: fastestmirror, presto
Setting up Install Process
Loading mirror speeds from cached hostfile
epel/metalink                                                                                                                                                                            | 7.7 kB     00:00
 * base: ftp.iij.ad.jp
 * epel: ftp.iij.ad.jp
 * extras: ftp.iij.ad.jp
 * updates: ftp.iij.ad.jp
epel                                                                                                                                                                                     | 3.2 kB     00:00
epel/primary                                                                                                                                                                             | 3.2 MB     00:00
epel                                                                                                                                                                                                12515/12515
Resolving Dependencies
--> Running transaction check
---> Package python-pip.noarch 0:7.1.0-1.el6 will be installed
--> Finished Dependency Resolution

Dependencies Resolved

================================================================================================================================================================================================================
 Package                                             Arch                                            Version                                                Repository                                     Size
================================================================================================================================================================================================================
Installing:
 python-pip                                          noarch                                          7.1.0-1.el6                                            epel                                          1.5 M

Transaction Summary
================================================================================================================================================================================================================
Install       1 Package(s)

Total download size: 1.5 M
Installed size: 6.6 M
Is this ok [y/N]: y
Downloading Packages:
Setting up and reading Presto delta metadata
epel/prestodelta                                                                                                                                                                         |  770 B     00:00
Processing delta metadata
Package(s) data still to download: 1.5 M
python-pip-7.1.0-1.el6.noarch.rpm                                                                                                                                                        | 1.5 MB     00:00
warning: rpmts_HdrFromFdno: Header V3 RSA/SHA256 Signature, key ID 0608b895: NOKEY
Retrieving key from file:///etc/pki/rpm-gpg/RPM-GPG-KEY-EPEL-6
Importing GPG key 0x0608B895:
 Userid : EPEL (6) <epel@fedoraproject.org>
 Package: epel-release-6-8.noarch (installed)
 From   : /etc/pki/rpm-gpg/RPM-GPG-KEY-EPEL-6
Is this ok [y/N]: y
Running rpm_check_debug
Running Transaction Test
Transaction Test Succeeded
Running Transaction
Warning: RPMDB altered outside of yum.
  Installing : python-pip-7.1.0-1.el6.noarch                                                                                                                                                                1/1
  Verifying  : python-pip-7.1.0-1.el6.noarch                                                                                                                                                                1/1

Installed:
  python-pip.noarch 0:7.1.0-1.el6

Complete!

[centos@ip-172-31-16-82 slab-nss]$ sudo yum install --enablerepo=epel python-pip

Loaded plugins: fastestmirror, presto

Setting up Install Process

Loading mirror speeds from cached hostfile

epel/metalink | 7.7 kB 00:00

* base: ftp.iij.ad.jp

* epel: ftp.iij.ad.jp

* extras: ftp.iij.ad.jp

* updates: ftp.iij.ad.jp

epel | 3.2 kB 00:00

epel/primary | 3.2 MB 00:00

epel 12515/12515

Resolving Dependencies

--> Running transaction check

---> Package python-pip.noarch 0:7.1.0-1.el6 will be installed

--> Finished Dependency Resolution

Dependencies Resolved

Package Arch Version Repository Size

Installing:

python-pip noarch 7.1.0-1.el6 epel 1.5 M

Transaction Summary

Install 1 Package(s)

Total download size: 1.5 M

Installed size: 6.6 M

Is this ok [y/N]: y

Downloading Packages:

Setting up and reading Presto delta metadata

epel/prestodelta | 770 B 00:00

Processing delta metadata

Package(s) data still to download: 1.5 M

python-pip-7.1.0-1.el6.noarch.rpm | 1.5 MB 00:00

warning: rpmts_HdrFromFdno: Header V3 RSA/SHA256 Signature, key ID 0608b895: NOKEY

Retrieving key from file:///etc/pki/rpm-gpg/RPM-GPG-KEY-EPEL-6

Importing GPG key 0x0608B895:

Userid : EPEL (6) <epel@fedoraproject.org>

Package: epel-release-6-8.noarch (installed)

From : /etc/pki/rpm-gpg/RPM-GPG-KEY-EPEL-6

Is this ok [y/N]: y

Running rpm_check_debug

Running Transaction Test

Transaction Test Succeeded

Running Transaction

Warning: RPMDB altered outside of yum.

Installing : python-pip-7.1.0-1.el6.noarch 1/1

Verifying : python-pip-7.1.0-1.el6.noarch 1/1

Installed:

python-pip.noarch 0:7.1.0-1.el6

Complete!

CentOS 6 の python 2.6.6 に pip を導入する手順

aws cli

[centos@ip-172-31-16-82 slab-nss]$ sudo pip install awscli
・・・
Successfully installed awscli-1.15.53 botocore-1.10.52 colorama-0.3.9 docutils-0.14 futures-3.2.0 jmespath-0.9.3 ordereddict-1.1 pyasn1-0.4.3 python-dateutil-2.6.1 rsa-3.4.2 s3transfer-0.1.13 simplejson-3.3.0

[centos@ip-172-31-16-82 slab-nss]$ sudo pip install awscli

・・・

Successfully installed awscli-1.15.53 botocore-1.10.52 colorama-0.3.9 docutils-0.14 futures-3.2.0 jmespath-0.9.3 ordereddict-1.1 pyasn1-0.4.3 python-dateutil-2.6.1 rsa-3.4.2 s3transfer-0.1.13 simplejson-3.3.0

https://docs.aws.amazon.com/ja_jp/cli/latest/userguide/awscli-install-linux.html

php5.5

[centos@ip-172-31-16-82 slab-nss]$ sudo yum install --enablerepo=remi --enablerepo=remi-php55 php
Loaded plugins: fastestmirror, presto
Setting up Install Process
Loading mirror speeds from cached hostfile
epel/metalink
 * base: ftp.iij.ad.jp
 * epel: ftp.iij.ad.jp
 * extras: ftp.iij.ad.jp
 * remi: ftp.riken.jp
 * remi-php55: ftp.riken.jp
 * remi-safe: ftp.riken.jp
 * updates: ftp.iij.ad.jp
base
extras
remi
remi/primary_db
remi-php55
remi-php55/primary_db
remi-safe
remi-safe/primary_db
updates
Resolving Dependencies
--> Running transaction check
---> Package php.x86_64 0:5.3.3-49.el6 will be updated
---> Package php.x86_64 0:5.5.38-8.el6.remi will be an update
--> Processing Dependency: php-common(x86-64) = 5.5.38-8.el6.remi for package: php-5.5.38-8.el6.remi.x86_64
--> Processing Dependency: php-cli(x86-64) = 5.5.38-8.el6.remi for package: php-5.5.38-8.el6.remi.x86_64
--> Running transaction check
---> Package php-cli.x86_64 0:5.3.3-49.el6 will be updated
---> Package php-cli.x86_64 0:5.5.38-8.el6.remi will be an update
---> Package php-common.x86_64 0:5.3.3-49.el6 will be updated
---> Package php-common.x86_64 0:5.5.38-8.el6.remi will be an update
--> Processing Dependency: php-pecl-zip(x86-64) for package: php-common-5.5.38-8.el6.remi.x86_64
--> Processing Dependency: php-pecl-jsonc(x86-64) for package: php-common-5.5.38-8.el6.remi.x86_64
--> Running transaction check
---> Package php-pecl-jsonc.x86_64 0:1.3.10-2.el6.remi.5.5 will be installed
---> Package php-pecl-zip.x86_64 0:1.15.3-1.el6.remi.5.5 will be installed
--> Processing Dependency: libzip5(x86-64) >= 1.5.1 for package: php-pecl-zip-1.15.3-1.el6.remi.5.5.x86_64
--> Processing Dependency: libzip.so.5()(64bit) for package: php-pecl-zip-1.15.3-1.el6.remi.5.5.x86_64
--> Running transaction check
---> Package libzip5.x86_64 0:1.5.1-1.el6.remi will be installed
--> Finished Dependency Resolution

Dependencies Resolved

=======================================================================================================================================================
 Package                                            Arch                                       Version
=======================================================================================================================================================
Updating:
 php                                                x86_64                                     5.5.38-8.el6.remi
Installing for dependencies:
 libzip5                                            x86_64                                     1.5.1-1.el6.remi
 php-pecl-jsonc                                     x86_64                                     1.3.10-2.el6.remi.5.5
 php-pecl-zip                                       x86_64                                     1.15.3-1.el6.remi.5.5
Updating for dependencies:
 php-cli                                            x86_64                                     5.5.38-8.el6.remi
 php-common                                         x86_64                                     5.5.38-8.el6.remi

Transaction Summary
=======================================================================================================================================================
Install       3 Package(s)
Upgrade       3 Package(s)

Total download size: 7.8 M
Is this ok [y/N]: y
Downloading Packages:
Setting up and reading Presto delta metadata
Processing delta metadata
Package(s) data still to download: 7.8 M
(1/6): libzip5-1.5.1-1.el6.remi.x86_64.rpm
(2/6): php-5.5.38-8.el6.remi.x86_64.rpm
(3/6): php-cli-5.5.38-8.el6.remi.x86_64.rpm
(4/6): php-common-5.5.38-8.el6.remi.x86_64.rpm
(5/6): php-pecl-jsonc-1.3.10-2.el6.remi.5.5.x86_64.rpm
(6/6): php-pecl-zip-1.15.3-1.el6.remi.5.5.x86_64.rpm
-------------------------------------------------------------------------------------------------------------------------------------------------------
Total
warning: rpmts_HdrFromFdno: Header V4 DSA/SHA1 Signature, key ID 00f97f56: NOKEY
Retrieving key from file:///etc/pki/rpm-gpg/RPM-GPG-KEY-remi
Importing GPG key 0x00F97F56:
 Userid : Remi Collet <RPMS@FamilleCollet.com>
 Package: remi-release-6.9-3.el6.remi.noarch (installed)
 From   : /etc/pki/rpm-gpg/RPM-GPG-KEY-remi
Is this ok [y/N]: y
Running rpm_check_debug
Running Transaction Test
Transaction Test Succeeded
Running Transaction
Warning: RPMDB altered outside of yum.
  Installing : libzip5-1.5.1-1.el6.remi.x86_64
  Installing : php-pecl-jsonc-1.3.10-2.el6.remi.5.5.x86_64

WARNING : These php-* RPMs are not official Fedora / Red Hat build and
overrides the official ones. Don't file bugs on Fedora Project nor Red Hat.

Use dedicated forum at http://forum.remirepo.net/

  Updating   : php-common-5.5.38-8.el6.remi.x86_64
  Installing : php-pecl-zip-1.15.3-1.el6.remi.5.5.x86_64
  Updating   : php-cli-5.5.38-8.el6.remi.x86_64
  Updating   : php-5.5.38-8.el6.remi.x86_64
  Cleanup    : php-5.3.3-49.el6.x86_64
  Cleanup    : php-cli-5.3.3-49.el6.x86_64
  Cleanup    : php-common-5.3.3-49.el6.x86_64
==========================================================================

 WARNING : PHP 5.5 have reached its "End of Life" in July 2016.
 Even, if this package includes some security fix, backported from 5.6,
 The UPGRADE to a maintained version is very strongly RECOMMENDED.

==========================================================================
  Verifying  : libzip5-1.5.1-1.el6.remi.x86_64
  Verifying  : php-pecl-zip-1.15.3-1.el6.remi.5.5.x86_64
  Verifying  : php-cli-5.5.38-8.el6.remi.x86_64
  Verifying  : php-pecl-jsonc-1.3.10-2.el6.remi.5.5.x86_64
  Verifying  : php-common-5.5.38-8.el6.remi.x86_64
  Verifying  : php-5.5.38-8.el6.remi.x86_64
  Verifying  : php-cli-5.3.3-49.el6.x86_64
  Verifying  : php-5.3.3-49.el6.x86_64
  Verifying  : php-common-5.3.3-49.el6.x86_64

Dependency Installed:
  libzip5.x86_64 0:1.5.1-1.el6.remi                            php-pecl-jsonc.x86_64 0:1.3.10-2.el6.remi.5.5                            php-pecl-zip.x8

Updated:
  php.x86_64 0:5.5.38-8.el6.remi

Dependency Updated:
  php-cli.x86_64 0:5.5.38-8.el6.remi                                                                    php-common.x86_64 0:5.5.38-8.el6.remi

Complete!

100

101

102

103

104

105

106

107

108

109

110

111

112

113

114

115

116

117

118

119

120

121

122

123

124

125

126

127

128

129

130

131

[centos@ip-172-31-16-82 slab-nss]$ sudo yum install --enablerepo=remi --enablerepo=remi-php55 php

Loaded plugins: fastestmirror, presto

Setting up Install Process

Loading mirror speeds from cached hostfile

epel/metalink

* base: ftp.iij.ad.jp

* epel: ftp.iij.ad.jp

* extras: ftp.iij.ad.jp

* remi: ftp.riken.jp

* remi-php55: ftp.riken.jp

* remi-safe: ftp.riken.jp

* updates: ftp.iij.ad.jp

base

extras

remi

remi/primary_db

remi-php55

remi-php55/primary_db

remi-safe

remi-safe/primary_db

updates

Resolving Dependencies

--> Running transaction check

---> Package php.x86_64 0:5.3.3-49.el6 will be updated

---> Package php.x86_64 0:5.5.38-8.el6.remi will be an update

--> Processing Dependency: php-common(x86-64) = 5.5.38-8.el6.remi for package: php-5.5.38-8.el6.remi.x86_64

--> Processing Dependency: php-cli(x86-64) = 5.5.38-8.el6.remi for package: php-5.5.38-8.el6.remi.x86_64

--> Running transaction check

---> Package php-cli.x86_64 0:5.3.3-49.el6 will be updated

---> Package php-cli.x86_64 0:5.5.38-8.el6.remi will be an update

---> Package php-common.x86_64 0:5.3.3-49.el6 will be updated

---> Package php-common.x86_64 0:5.5.38-8.el6.remi will be an update

--> Processing Dependency: php-pecl-zip(x86-64) for package: php-common-5.5.38-8.el6.remi.x86_64

--> Processing Dependency: php-pecl-jsonc(x86-64) for package: php-common-5.5.38-8.el6.remi.x86_64

--> Running transaction check

---> Package php-pecl-jsonc.x86_64 0:1.3.10-2.el6.remi.5.5 will be installed

---> Package php-pecl-zip.x86_64 0:1.15.3-1.el6.remi.5.5 will be installed

--> Processing Dependency: libzip5(x86-64) >= 1.5.1 for package: php-pecl-zip-1.15.3-1.el6.remi.5.5.x86_64

--> Processing Dependency: libzip.so.5()(64bit) for package: php-pecl-zip-1.15.3-1.el6.remi.5.5.x86_64

--> Running transaction check

---> Package libzip5.x86_64 0:1.5.1-1.el6.remi will be installed

--> Finished Dependency Resolution

Dependencies Resolved

=======================================================================================================================================================

Package Arch Version

=======================================================================================================================================================

Updating:

php x86_64 5.5.38-8.el6.remi

Installing for dependencies:

libzip5 x86_64 1.5.1-1.el6.remi

php-pecl-jsonc x86_64 1.3.10-2.el6.remi.5.5

php-pecl-zip x86_64 1.15.3-1.el6.remi.5.5

Updating for dependencies:

php-cli x86_64 5.5.38-8.el6.remi

php-common x86_64 5.5.38-8.el6.remi

Transaction Summary

=======================================================================================================================================================

Install 3 Package(s)

Upgrade 3 Package(s)

Total download size: 7.8 M

Is this ok [y/N]: y

Downloading Packages:

Setting up and reading Presto delta metadata

Processing delta metadata

Package(s) data still to download: 7.8 M

(1/6): libzip5-1.5.1-1.el6.remi.x86_64.rpm

(2/6): php-5.5.38-8.el6.remi.x86_64.rpm

(3/6): php-cli-5.5.38-8.el6.remi.x86_64.rpm

(4/6): php-common-5.5.38-8.el6.remi.x86_64.rpm

(5/6): php-pecl-jsonc-1.3.10-2.el6.remi.5.5.x86_64.rpm

(6/6): php-pecl-zip-1.15.3-1.el6.remi.5.5.x86_64.rpm

-------------------------------------------------------------------------------------------------------------------------------------------------------

Total

warning: rpmts_HdrFromFdno: Header V4 DSA/SHA1 Signature, key ID 00f97f56: NOKEY

Retrieving key from file:///etc/pki/rpm-gpg/RPM-GPG-KEY-remi

Importing GPG key 0x00F97F56:

Userid : Remi Collet <RPMS@FamilleCollet.com>

Package: remi-release-6.9-3.el6.remi.noarch (installed)

From : /etc/pki/rpm-gpg/RPM-GPG-KEY-remi

Is this ok [y/N]: y

Running rpm_check_debug

Running Transaction Test

Transaction Test Succeeded

Running Transaction

Warning: RPMDB altered outside of yum.

Installing : libzip5-1.5.1-1.el6.remi.x86_64

Installing : php-pecl-jsonc-1.3.10-2.el6.remi.5.5.x86_64

WARNING : These php-* RPMs are not official Fedora / Red Hat build and

overrides the official ones. Don't file bugs on Fedora Project nor Red Hat.

Use dedicated forum at http://forum.remirepo.net/

Updating : php-common-5.5.38-8.el6.remi.x86_64

Installing : php-pecl-zip-1.15.3-1.el6.remi.5.5.x86_64

Updating : php-cli-5.5.38-8.el6.remi.x86_64

Updating : php-5.5.38-8.el6.remi.x86_64

Cleanup : php-5.3.3-49.el6.x86_64

Cleanup : php-cli-5.3.3-49.el6.x86_64

Cleanup : php-common-5.3.3-49.el6.x86_64

==========================================================================

WARNING : PHP 5.5 have reached its "End of Life" in July 2016.

Even, if this package includes some security fix, backported from 5.6,

The UPGRADE to a maintained version is very strongly RECOMMENDED.

==========================================================================

Verifying : libzip5-1.5.1-1.el6.remi.x86_64

Verifying : php-pecl-zip-1.15.3-1.el6.remi.5.5.x86_64

Verifying : php-cli-5.5.38-8.el6.remi.x86_64

Verifying : php-pecl-jsonc-1.3.10-2.el6.remi.5.5.x86_64

Verifying : php-common-5.5.38-8.el6.remi.x86_64

Verifying : php-5.5.38-8.el6.remi.x86_64

Verifying : php-cli-5.3.3-49.el6.x86_64

Verifying : php-5.3.3-49.el6.x86_64

Verifying : php-common-5.3.3-49.el6.x86_64

Dependency Installed:

libzip5.x86_64 0:1.5.1-1.el6.remi php-pecl-jsonc.x86_64 0:1.3.10-2.el6.remi.5.5 php-pecl-zip.x8

Updated:

php.x86_64 0:5.5.38-8.el6.remi

Dependency Updated:

php-cli.x86_64 0:5.5.38-8.el6.remi php-common.x86_64 0:5.5.38-8.el6.remi

Complete!

php-xml

[centos@ip-172-31-16-82 slab-nss]$ php publish.php
PHP Fatal error:  Class 'SimpleXMLElement' not found in /home/centos/aws/slab-nss/vendor/guzzle/guzzle/src/Guzzle/Http/Message/Response.php on line 886

1 2	[centos@ip-172-31-16-82 slab-nss]$ php publish.php PHP Fatal error: Class 'SimpleXMLElement' not found in /home/centos/aws/slab-nss/vendor/guzzle/guzzle/src/Guzzle/Http/Message/Response.php on line 886

こんなエラーが出たので、

[centos@ip-172-31-16-82 slab-nss]$ sudo yum install --enablerepo=remi --enablerepo=remi-php55 php-xml
Loaded plugins: fastestmirror, presto
Setting up Install Process
Loading mirror speeds from cached hostfile
 * base: ftp.iij.ad.jp
 * epel: mirrors.aliyun.com
 * extras: ftp.iij.ad.jp
 * remi: ftp.riken.jp
 * remi-php55: ftp.riken.jp
 * remi-safe: ftp.riken.jp
 * updates: ftp.iij.ad.jp
Resolving Dependencies
--> Running transaction check
---> Package php-xml.x86_64 0:5.5.38-8.el6.remi will be installed
--> Processing Dependency: libxslt.so.1(LIBXML2_1.0.24)(64bit) for package: php-xml-5.5.38-8.el6.remi.x86_64
--> Processing Dependency: libxslt.so.1(LIBXML2_1.0.22)(64bit) for package: php-xml-5.5.38-8.el6.remi.x86_64
--> Processing Dependency: libxslt.so.1(LIBXML2_1.0.18)(64bit) for package: php-xml-5.5.38-8.el6.remi.x86_64
--> Processing Dependency: libxslt.so.1(LIBXML2_1.0.13)(64bit) for package: php-xml-5.5.38-8.el6.remi.x86_64
--> Processing Dependency: libxslt.so.1(LIBXML2_1.0.11)(64bit) for package: php-xml-5.5.38-8.el6.remi.x86_64
--> Processing Dependency: libxslt.so.1()(64bit) for package: php-xml-5.5.38-8.el6.remi.x86_64
--> Processing Dependency: libexslt.so.0()(64bit) for package: php-xml-5.5.38-8.el6.remi.x86_64
--> Running transaction check
---> Package libxslt.x86_64 0:1.1.26-2.el6_3.1 will be installed
--> Finished Dependency Resolution

Dependencies Resolved

=======================================================================================================================================================
 Package                                        Arch                                          Version
=======================================================================================================================================================
Installing:
 php-xml                                        x86_64                                        5.5.38-8.el6.remi
Installing for dependencies:
 libxslt                                        x86_64                                        1.1.26-2.el6_3.1

Transaction Summary
=======================================================================================================================================================
Install       2 Package(s)

Total download size: 670 k
Installed size: 2.9 M
Is this ok [y/N]: y
Downloading Packages:
Setting up and reading Presto delta metadata
Processing delta metadata
Package(s) data still to download: 670 k
(1/2): libxslt-1.1.26-2.el6_3.1.x86_64.rpm
(2/2): php-xml-5.5.38-8.el6.remi.x86_64.rpm
-------------------------------------------------------------------------------------------------------------------------------------------------------
Total
Running rpm_check_debug
Running Transaction Test
Transaction Test Succeeded
Running Transaction
  Installing : libxslt-1.1.26-2.el6_3.1.x86_64
  Installing : php-xml-5.5.38-8.el6.remi.x86_64
  Verifying  : libxslt-1.1.26-2.el6_3.1.x86_64
  Verifying  : php-xml-5.5.38-8.el6.remi.x86_64

Installed:
  php-xml.x86_64 0:5.5.38-8.el6.remi

Dependency Installed:
  libxslt.x86_64 0:1.1.26-2.el6_3.1

Complete!

[centos@ip-172-31-16-82 slab-nss]$ sudo yum install --enablerepo=remi --enablerepo=remi-php55 php-xml

Loaded plugins: fastestmirror, presto

Setting up Install Process

Loading mirror speeds from cached hostfile

* base: ftp.iij.ad.jp

* epel: mirrors.aliyun.com

* extras: ftp.iij.ad.jp

* remi: ftp.riken.jp

* remi-php55: ftp.riken.jp

* remi-safe: ftp.riken.jp

* updates: ftp.iij.ad.jp

Resolving Dependencies

--> Running transaction check

---> Package php-xml.x86_64 0:5.5.38-8.el6.remi will be installed

--> Processing Dependency: libxslt.so.1(LIBXML2_1.0.24)(64bit) for package: php-xml-5.5.38-8.el6.remi.x86_64

--> Processing Dependency: libxslt.so.1(LIBXML2_1.0.22)(64bit) for package: php-xml-5.5.38-8.el6.remi.x86_64

--> Processing Dependency: libxslt.so.1(LIBXML2_1.0.18)(64bit) for package: php-xml-5.5.38-8.el6.remi.x86_64

--> Processing Dependency: libxslt.so.1(LIBXML2_1.0.13)(64bit) for package: php-xml-5.5.38-8.el6.remi.x86_64

--> Processing Dependency: libxslt.so.1(LIBXML2_1.0.11)(64bit) for package: php-xml-5.5.38-8.el6.remi.x86_64

--> Processing Dependency: libxslt.so.1()(64bit) for package: php-xml-5.5.38-8.el6.remi.x86_64

--> Processing Dependency: libexslt.so.0()(64bit) for package: php-xml-5.5.38-8.el6.remi.x86_64

--> Running transaction check

---> Package libxslt.x86_64 0:1.1.26-2.el6_3.1 will be installed

--> Finished Dependency Resolution

Dependencies Resolved

=======================================================================================================================================================

Package Arch Version

=======================================================================================================================================================

Installing:

php-xml x86_64 5.5.38-8.el6.remi

Installing for dependencies:

libxslt x86_64 1.1.26-2.el6_3.1

Transaction Summary

=======================================================================================================================================================

Install 2 Package(s)

Total download size: 670 k

Installed size: 2.9 M

Is this ok [y/N]: y

Downloading Packages:

Setting up and reading Presto delta metadata

Processing delta metadata

Package(s) data still to download: 670 k

(1/2): libxslt-1.1.26-2.el6_3.1.x86_64.rpm

(2/2): php-xml-5.5.38-8.el6.remi.x86_64.rpm

-------------------------------------------------------------------------------------------------------------------------------------------------------

Total

Running rpm_check_debug

Running Transaction Test

Transaction Test Succeeded

Running Transaction

Installing : libxslt-1.1.26-2.el6_3.1.x86_64

Installing : php-xml-5.5.38-8.el6.remi.x86_64

Verifying : libxslt-1.1.26-2.el6_3.1.x86_64

Verifying : php-xml-5.5.38-8.el6.remi.x86_64

Installed:

php-xml.x86_64 0:5.5.38-8.el6.remi

Dependency Installed:

libxslt.x86_64 0:1.1.26-2.el6_3.1

Complete!

AWSのt2.microでAWS SKDのcomposerがこけたので、スワップを作成

コメントを残す

[centos@ip-172-31-16-82 slab-nss]$ composer.phar update
Loading composer repositories with package information
Updating dependencies (including require-dev)
Package operations: 3 installs, 0 updates, 0 removals
  - Installing symfony/event-dispatcher (v2.6.13): Downloading (100%)
The following exception is caused by a lack of memory or swap, or not having swap configured
Check https://getcomposer.org/doc/articles/troubleshooting.md#proc-open-fork-failed-errors for details

PHP Warning:  proc_open(): fork failed - Cannot allocate memory in phar:///usr/local/bin/composer.phar/vendor/symfony/console/Application.php on line 959

Warning: proc_open(): fork failed - Cannot allocate memory in phar:///usr/local/bin/composer.phar/vendor/symfony/console/Application.php on line 959

  [ErrorException]
  proc_open(): fork failed - Cannot allocate memory


update [--prefer-source] [--prefer-dist] [--dry-run] [--dev] [--no-dev] [--lock] [--no-custom-installers] [--no-autoloader] [--no-scripts] [--no-progress] [--no-suggest] [--with-dependencies] [--with-all-dependencies] [-v|vv|vvv|--verbose] [-o|--optimize-autoloader] [-a|--classmap-authoritative] [--apcu-autoloader] [--ignore-platform-reqs] [--prefer-stable] [--prefer-lowest] [-i|--interactive] [--root-reqs] [--] [<packages>]...

[centos@ip-172-31-16-82 slab-nss]$ composer.phar update

Loading composer repositories with package information

Updating dependencies (including require-dev)

Package operations: 3 installs, 0 updates, 0 removals

- Installing symfony/event-dispatcher (v2.6.13): Downloading (100%)

The following exception is caused by a lack of memory or swap, or not having swap configured

Check https://getcomposer.org/doc/articles/troubleshooting.md#proc-open-fork-failed-errors for details

PHP Warning: proc_open(): fork failed - Cannot allocate memory in phar:///usr/local/bin/composer.phar/vendor/symfony/console/Application.php on line 959

Warning: proc_open(): fork failed - Cannot allocate memory in phar:///usr/local/bin/composer.phar/vendor/symfony/console/Application.php on line 959

[ErrorException]

proc_open(): fork failed - Cannot allocate memory

update [--prefer-source] [--prefer-dist] [--dry-run] [--dev] [--no-dev] [--lock] [--no-custom-installers] [--no-autoloader] [--no-scripts] [--no-progress] [--no-suggest] [--with-dependencies] [--with-all-dependencies] [-v|vv|vvv|--verbose] [-o|--optimize-autoloader] [-a|--classmap-authoritative] [--apcu-autoloader] [--ignore-platform-reqs] [--prefer-stable] [--prefer-lowest] [-i|--interactive] [--root-reqs] [--] [<packages>]...

となったので、

[root@ip-172-31-16-82 slab-nss]# /bin/dd if=/dev/zero of=/var/swap.1 bs=1M count=1024
1024+0 records in
1024+0 records out
1073741824 bytes (1.1 GB) copied, 15.1272 s, 71.0 MB/s
[root@ip-172-31-16-82 slab-nss]# /sbin/mkswap /var/swap.1
Setting up swapspace version 1, size = 1048572 KiB
no label, UUID=001c4bd6-1612-4241-9a0c-8fe3b27f5e08
[root@ip-172-31-16-82 slab-nss]# /sbin/swapon /var/swap.1

[root@ip-172-31-16-82 slab-nss]# /bin/dd if=/dev/zero of=/var/swap.1 bs=1M count=1024

1024+0 records in

1024+0 records out

1073741824 bytes (1.1 GB) copied, 15.1272 s, 71.0 MB/s

[root@ip-172-31-16-82 slab-nss]# /sbin/mkswap /var/swap.1

Setting up swapspace version 1, size = 1048572 KiB

no label, UUID=001c4bd6-1612-4241-9a0c-8fe3b27f5e08

[root@ip-172-31-16-82 slab-nss]# /sbin/swapon /var/swap.1

と作成

[centos@ip-172-31-16-82 slab-nss]$ composer.phar update
Loading composer repositories with package information
Updating dependencies (including require-dev)
Package operations: 3 installs, 0 updates, 0 removals
  - Installing symfony/event-dispatcher (v2.6.13): Loading from cache
  - Installing guzzle/guzzle (v3.9.3): Downloading (100%)
  - Installing aws/aws-sdk-php (2.8.31): Downloading (100%)
symfony/event-dispatcher suggests installing symfony/dependency-injection ()
symfony/event-dispatcher suggests installing symfony/http-kernel ()
guzzle/guzzle suggests installing guzzlehttp/guzzle (Guzzle 5 has moved to a new package name. The package you have installed, Guzzle 3, is deprecated.)
aws/aws-sdk-php suggests installing doctrine/cache (Adds support for caching of credentials and responses)
aws/aws-sdk-php suggests installing ext-apc (Allows service description opcode caching, request and response caching, and credentials caching)
aws/aws-sdk-php suggests installing monolog/monolog (Adds support for logging HTTP requests and responses)
aws/aws-sdk-php suggests installing symfony/yaml (Eases the ability to write manifests for creating jobs in AWS Import/Export)
Package guzzle/guzzle is abandoned, you should avoid using it. Use guzzlehttp/guzzle instead.
Writing lock file
Generating autoload files

[centos@ip-172-31-16-82 slab-nss]$ composer.phar update

Loading composer repositories with package information

Updating dependencies (including require-dev)

Package operations: 3 installs, 0 updates, 0 removals

- Installing symfony/event-dispatcher (v2.6.13): Loading from cache

- Installing guzzle/guzzle (v3.9.3): Downloading (100%)

- Installing aws/aws-sdk-php (2.8.31): Downloading (100%)

symfony/event-dispatcher suggests installing symfony/dependency-injection ()

symfony/event-dispatcher suggests installing symfony/http-kernel ()

guzzle/guzzle suggests installing guzzlehttp/guzzle (Guzzle 5 has moved to a new package name. The package you have installed, Guzzle 3, is deprecated.)

aws/aws-sdk-php suggests installing doctrine/cache (Adds support for caching of credentials and responses)

aws/aws-sdk-php suggests installing ext-apc (Allows service description opcode caching, request and response caching, and credentials caching)

aws/aws-sdk-php suggests installing monolog/monolog (Adds support for logging HTTP requests and responses)

aws/aws-sdk-php suggests installing symfony/yaml (Eases the ability to write manifests for creating jobs in AWS Import/Export)

Package guzzle/guzzle is abandoned, you should avoid using it. Use guzzlehttp/guzzle instead.

Writing lock file

Generating autoload files

とできた。

slab増大とcurlのNSS_SDB_USE_CACHE対策の効果確認

コメントを残す

AWS SDKを使用しているとslabが肥大化していく現象

NSS_SDB_USE_CACHE=yesが利用できるのが、nss3.16以上とあるが、

nss-softokn-3.14.3-12.el6 という情報もあるため、確認

https://bugzilla.redhat.com/show_bug.cgi?id=1044666

http://tama1029hq.hatenablog.com/entry/2016/12/12/105353

—

Amazon Linux

[root@freeserver ec2-user]# rpm -qa | grep nss-softokn
nss-softokn-3.16.2.3-14.2.38.amzn1.x86_64
nss-softokn-freebl-3.16.2.3-14.2.38.amzn1.x86_64
[root@freeserver ec2-user]# curl -V
curl 7.47.1 (x86_64-redhat-linux-gnu) libcurl/7.47.1 NSS/3.21 Basic ECC zlib/1.2.8 libidn/1.18 libpsl/0.6.2 (+libicu/50.1.2) libssh2/1.4.2
Protocols: dict file ftp ftps gopher http https imap imaps ldap ldaps pop3 pop3s rtsp scp sftp smb smbs smtp smtps telnet tftp
Features: AsynchDNS IDN IPv6 Largefile GSS-API Kerberos SPNEGO NTLM NTLM_WB SSL libz UnixSockets PSL

[root@freeserver ec2-user]# rpm -qa | grep nss-softokn

nss-softokn-3.16.2.3-14.2.38.amzn1.x86_64

nss-softokn-freebl-3.16.2.3-14.2.38.amzn1.x86_64

[root@freeserver ec2-user]# curl -V

curl 7.47.1 (x86_64-redhat-linux-gnu) libcurl/7.47.1 NSS/3.21 Basic ECC zlib/1.2.8 libidn/1.18 libpsl/0.6.2 (+libicu/50.1.2) libssh2/1.4.2

Protocols: dict file ftp ftps gopher http https imap imaps ldap ldaps pop3 pop3s rtsp scp sftp smb smbs smtp smtps telnet tftp

Features: AsynchDNS IDN IPv6 Largefile GSS-API Kerberos SPNEGO NTLM NTLM_WB SSL libz UnixSockets PSL

この場合、NSS/3.21が有効なのだろうか。

[root@freeserver ec2-user]# strace -fc -e trace=access curl -s https://www.google.co.jp/ > /dev/null
Process 29754 attached
% time     seconds  usecs/call     calls    errors syscall
------ ----------- ----------- --------- --------- ----------------
100.00    0.000008           0      5383      5378 access
------ ----------- ----------- --------- --------- ----------------
100.00    0.000008                  5383      5378 total
[root@freeserver ec2-user]# NSS_SDB_USE_CACHE=yes strace -fc -e trace=access curl -s https://www.google.co.jp/ > /dev/null
Process 29780 attached
% time     seconds  usecs/call     calls    errors syscall
------ ----------- ----------- --------- --------- ----------------
  0.00    0.000000           0        17        14 access
------ ----------- ----------- --------- --------- ----------------
100.00    0.000000                    17        14 total
[root@freeserver ec2-user]# yum list nss-softokn

[root@freeserver ec2-user]# strace -fc -e trace=access curl -s https://www.google.co.jp/ > /dev/null

Process 29754 attached

% time seconds usecs/call calls errors syscall

------ ----------- ----------- --------- --------- ----------------

100.00 0.000008 0 5383 5378 access

------ ----------- ----------- --------- --------- ----------------

100.00 0.000008 5383 5378 total

[root@freeserver ec2-user]# NSS_SDB_USE_CACHE=yes strace -fc -e trace=access curl -s https://www.google.co.jp/ > /dev/null

Process 29780 attached

% time seconds usecs/call calls errors syscall

------ ----------- ----------- --------- --------- ----------------

0.00 0.000000 0 17 14 access

------ ----------- ----------- --------- --------- ----------------

100.00 0.000000 17 14 total

[root@freeserver ec2-user]# yum list nss-softokn

→効いている。

—

さくら（CentOS release 6.6 (Final)）

[nilesflow@dev ~]$ cat /etc/redhat-release
CentOS release 6.6 (Final)
[nilesflow@dev ~]$ rpm -qa | grep nss-softokn
nss-softokn-3.14.3-18.el6_6.x86_64
nss-softokn-freebl-3.14.3-18.el6_6.x86_64
[nilesflow@dev ~]$ curl -V
curl 7.46.0 (x86_64-pc-linux-gnu) libcurl/7.46.0 OpenSSL/1.0.1e zlib/1.2.3 libidn/1.18
Protocols: dict file ftp ftps gopher http https imap imaps ldap ldaps pop3 pop3s rtsp smb smbs smtp smtps telnet tftp
Features: IDN IPv6 Largefile NTLM NTLM_WB SSL libz UnixSockets

[nilesflow@dev ~]$ cat /etc/redhat-release

CentOS release 6.6 (Final)

[nilesflow@dev ~]$ rpm -qa | grep nss-softokn

nss-softokn-3.14.3-18.el6_6.x86_64

nss-softokn-freebl-3.14.3-18.el6_6.x86_64

[nilesflow@dev ~]$ curl -V

curl 7.46.0 (x86_64-pc-linux-gnu) libcurl/7.46.0 OpenSSL/1.0.1e zlib/1.2.3 libidn/1.18

Protocols: dict file ftp ftps gopher http https imap imaps ldap ldaps pop3 pop3s rtsp smb smbs smtp smtps telnet tftp

Features: IDN IPv6 Largefile NTLM NTLM_WB SSL libz UnixSockets

[nilesflow@dev ~]$ strace -fc -e trace=access curl 'https://www.google.com' > /dev/null
Process 3673 attached
Process 3673 detached
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100 12028    0 12028    0     0  84852      0 --:--:-- --:--:-- --:--:-- 87795
% time     seconds  usecs/call     calls    errors syscall
------ ----------- ----------- --------- --------- ----------------
  -nan    0.000000           0         3         2 access
------ ----------- ----------- --------- --------- ----------------
100.00    0.000000                     3         2 total

[nilesflow@dev ~]$ strace -fc -e trace=access curl 'https://www.google.com' > /dev/null

Process 3673 attached

Process 3673 detached

% Total % Received % Xferd Average Speed Time Time Time Current

Dload Upload Total Spent Left Speed

100 12028 0 12028 0 0 84852 0 --:--:-- --:--:-- --:--:-- 87795

% time seconds usecs/call calls errors syscall

------ ----------- ----------- --------- --------- ----------------

-nan 0.000000 0 3 2 access

------ ----------- ----------- --------- --------- ----------------

100.00 0.000000 3 2 total

→再現しない

—

CentOS6.9（Amazonマーケットプレイス）

[centos@ip-172-31-16-82 ~]$ cat /etc/redhat-release
CentOS release 6.9 (Final)
[centos@ip-172-31-16-82 ~]$ rpm -qa | grep nss-softokn
nss-softokn-freebl-3.14.3-23.3.el6_8.x86_64
nss-softokn-3.14.3-23.3.el6_8.x86_64
[centos@ip-172-31-16-82 ~]$ curl -V
curl 7.19.7 (x86_64-redhat-linux-gnu) libcurl/7.19.7 NSS/3.27.1 zlib/1.2.3 libidn/1.18 libssh2/1.4.2
Protocols: tftp ftp telnet dict ldap ldaps http file https ftps scp sftp
Features: GSS-Negotiate IDN IPv6 Largefile NTLM SSL libz

[centos@ip-172-31-16-82 ~]$ cat /etc/redhat-release

CentOS release 6.9 (Final)

[centos@ip-172-31-16-82 ~]$ rpm -qa | grep nss-softokn

nss-softokn-freebl-3.14.3-23.3.el6_8.x86_64

nss-softokn-3.14.3-23.3.el6_8.x86_64

[centos@ip-172-31-16-82 ~]$ curl -V

curl 7.19.7 (x86_64-redhat-linux-gnu) libcurl/7.19.7 NSS/3.27.1 zlib/1.2.3 libidn/1.18 libssh2/1.4.2

Protocols: tftp ftp telnet dict ldap ldaps http file https ftps scp sftp

Features: GSS-Negotiate IDN IPv6 Largefile NTLM SSL libz

[centos@ip-172-31-16-82 ~]$ strace -fc -e trace=access curl -s https://www.google.co.jp/ > /dev/null
% time     seconds  usecs/call     calls    errors syscall
------ ----------- ----------- --------- --------- ----------------
100.00    0.000072           0      1811      1808 access
------ ----------- ----------- --------- --------- ----------------
100.00    0.000072                  1811      1808 total
[centos@ip-172-31-16-82 ~]$ NSS_SDB_USE_CACHE=yes  strace -fc -e trace=access curl -s https://www.google.co.jp/ > /dev/null
% time     seconds  usecs/call     calls    errors syscall
------ ----------- ----------- --------- --------- ----------------
  0.00    0.000000           0        24        21 access
------ ----------- ----------- --------- --------- ----------------
100.00    0.000000                    24        21 total

[centos@ip-172-31-16-82 ~]$ strace -fc -e trace=access curl -s https://www.google.co.jp/ > /dev/null

% time seconds usecs/call calls errors syscall

------ ----------- ----------- --------- --------- ----------------

100.00 0.000072 0 1811 1808 access

------ ----------- ----------- --------- --------- ----------------

100.00 0.000072 1811 1808 total

[centos@ip-172-31-16-82 ~]$ NSS_SDB_USE_CACHE=yes strace -fc -e trace=access curl -s https://www.google.co.jp/ > /dev/null

% time seconds usecs/call calls errors syscall

------ ----------- ----------- --------- --------- ----------------

0.00 0.000000 0 24 21 access

------ ----------- ----------- --------- --------- ----------------

100.00 0.000000 24 21 total

→効いている

furoom

月別アーカイブ:2018年7月

AWS SDK for PHPでのslab増大とNSS_SDB_USE_CACHE対策の効果確認

まとめ

各種情報

AWS-SDKでSNSへpublishするテストコードを準備

実行前後の情報

対策コードを追加

実行前後の情報

GuzzleHttp

curl と nss

curlをmakeして確かめてみる

CentOS6.6 に wget, epel, pip, aws cli のインストール

wget

epel

pip

aws cli

php5.5

php-xml

AWSのt2.microでAWS SKDのcomposerがこけたので、スワップを作成

slab増大とcurlのNSS_SDB_USE_CACHE対策の効果確認