Aws-iot-device-sdk-python-v2: Problems with the instalation

Created on 13 Oct 2020  ·  16Comments  ·  Source: aws/aws-iot-device-sdk-python-v2

After looking to most of theclosedissues in this page, there are several discussing about this issue, but none solves it for me.

When itry toinstall either with
python3 -m pip install awsiotsdk or
git clone https://github.com/aws/aws-iot-device-sdk-python-v2.git
python3 -m pip install ./aws-iot-device-sdk-python-v2

i get the following:

Collecting awsiotsdk
Using cached awsiotsdk-1.5.1-py3-none-any.whl (18 kB)
Collecting awscrt==0.9.3
Using cached awscrt-0.9.3.tar.gz (2.5 MB)
Building wheels for collected packages: awscrt
Building wheel for awscrt (setup.py) ... error
ERROR: Command errored out with exit status 1:
command: /usr/bin/python3 -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-un4mvgep/awscrt/setup.py'"'"'; __file__='"'"'/tmp/pip-install-un4mvgep/awscrt/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' bdist_wheel -d /tmp/pip-wheel-s5x44slu
cwd: /tmp/pip-install-un4mvgep/awscrt/
Complete output (112 lines):
running bdist_wheel
running build
running build_py
creating build
creating build/lib.linux-aarch64-3.6
creating build/lib.linux-aarch64-3.6/awscrt
copying awscrt/auth.py -> build/lib.linux-aarch64-3.6/awscrt
copying awscrt/crypto.py -> build/lib.linux-aarch64-3.6/awscrt
copying awscrt/http.py -> build/lib.linux-aarch64-3.6/awscrt
copying awscrt/io.py -> build/lib.linux-aarch64-3.6/awscrt
copying awscrt/mqtt.py -> build/lib.linux-aarch64-3.6/awscrt
copying awscrt/__init__.py -> build/lib.linux-aarch64-3.6/awscrt
copying awscrt/exceptions.py -> build/lib.linux-aarch64-3.6/awscrt
copying awscrt/awsiot_mqtt_connection_builder.py -> build/lib.linux-aarch64-3.6/awscrt
running build_ext
cmake version 3.10.2

CMake suite maintained and supported by Kitware (kitware.com/cmake).
--- Building dependency: s2n (RelWithDebInfo) ---
cmake -DCMAKE_PREFIX_PATH=/tmp/pip-install-un4mvgep/awscrt/build/deps/install -DCMAKE_INSTALL_PREFIX=/tmp/pip-install-un4mvgep/awscrt/build/deps/install -DBUILD_SHARED_LIBS=OFF -DCMAKE_BUILD_TYPE=RelWithDebInfo -DBUILD_TESTING=OFF -DCMAKE_INCLUDE_PATH=\"/usr/include/python3.6m\" -DLibCrypto_INCLUDE_DIR=/tmp/pip-install-un4mvgep/awscrt/build/deps/libcrypto/include -DLibCrypto_STATIC_LIBRARY=/tmp/pip-install-un4mvgep/awscrt/build/deps/libcrypto/lib/libcrypto.a /tmp/pip-install-un4mvgep/awscrt/crt/s2n
-- The C compiler identification is GNU 7.5.0
-- Check for working C compiler: /usr/bin/cc
-- Check for working C compiler: /usr/bin/cc -- works
-- Detecting C compiler ABI info
-- Detecting C compiler ABI info - done
-- Detecting C compile features
-- Detecting C compile features - done
-- Looking for pthread.h
-- Looking for pthread.h - found
-- Looking for pthread_create
-- Looking for pthread_create - not found
-- Check if compiler accepts -pthread
-- Check if compiler accepts -pthread - yes
-- Found Threads: TRUE
-- Attempting to try_compile PQ ASM
-- The ASM compiler identification is GNU
-- Found assembler: /usr/bin/cc
-- PQ ASM try_compile failed - using generic C code for PQ crypto
-- Performing Test S2N_HAVE_EXECINFO
-- Performing Test S2N_HAVE_EXECINFO - Success
-- Found LibCrypto: /tmp/pip-install-un4mvgep/awscrt/build/deps/libcrypto/lib/libcrypto.a
-- LibCrypto Include Dir: /tmp/pip-install-un4mvgep/awscrt/build/deps/libcrypto/include
-- LibCrypto Shared Lib: /usr/lib/aarch64-linux-gnu/libcrypto.so
-- LibCrypto Static Lib: /tmp/pip-install-un4mvgep/awscrt/build/deps/libcrypto/lib/libcrypto.a
-- Configuring done
CMake Error at CMakeLists.txt:191 (add_library):
Target "s2n" links to target "LibCrypto::Crypto" but the target was not
found. Perhaps a find_package() call is missing for an IMPORTED target, or
an ALIAS target is missing?

CMake Error at CMakeLists.txt:239 (target_include_directories):
Error evaluating generator expression:

  $<TARGET_PROPERTY:LibCrypto::Crypto,INTERFACE_INCLUDE_DIRECTORIES>

Target "LibCrypto::Crypto" not found.

CMake Error at CMakeLists.txt:239 (target_include_directories):
Error evaluating generator expression:

  $<TARGET_PROPERTY:LibCrypto::Crypto,INTERFACE_INCLUDE_DIRECTORIES>

Target "LibCrypto::Crypto" not found.

CMake Error at CMakeLists.txt:191 (add_library):
Target "s2n" links to target "LibCrypto::Crypto" but the target was not
found. Perhaps a find_package() call is missing for an IMPORTED target, or
an ALIAS target is missing?

-- Generating done
CMake Warning:
Manually-specified variables were not used by the project:

  CMAKE_INCLUDE_PATH

-- Build files have been written to: /tmp/pip-install-un4mvgep/awscrt/build/deps/s2n
Traceback (most recent call last):
File "", line 1, in
File "/tmp/pip-install-un4mvgep/awscrt/setup.py", line 263, in
'boto3'
File "/usr/lib/python3/dist-packages/setuptools/__init__.py", line 129, in setup
return distutils.core.setup(**attrs)
File "/usr/lib/python3.6/distutils/core.py", line 148, in setup
dist.run_commands()
File "/usr/lib/python3.6/distutils/dist.py", line 955, in run_commands
self.run_command(cmd)
File "/usr/lib/python3.6/distutils/dist.py", line 974, in run_command
cmd_obj.run()
File "/usr/lib/python3/dist-packages/wheel/bdist_wheel.py", line 204, in run
self.run_command('build')
File "/usr/lib/python3.6/distutils/cmd.py", line 313, in run_command
self.distribution.run_command(command)
File "/usr/lib/python3.6/distutils/dist.py", line 974, in run_command
cmd_obj.run()
File "/usr/lib/python3.6/distutils/command/build.py", line 135, in run
self.run_command(cmd_name)
File "/usr/lib/python3.6/distutils/cmd.py", line 313, in run_command
self.distribution.run_command(command)
File "/usr/lib/python3.6/distutils/dist.py", line 974, in run_command
cmd_obj.run()
File "/tmp/pip-install-un4mvgep/awscrt/setup.py", line 179, in run
self._build_dependency(lib)
File "/tmp/pip-install-un4mvgep/awscrt/setup.py", line 162, in _build_dependency
subprocess.check_call(cmake_args)
File "/usr/lib/python3.6/subprocess.py", line 311, in check_call
raise CalledProcessError(retcode, cmd)
subprocess.CalledProcessError: Command '['cmake', '-DCMAKE_PREFIX_PATH=/tmp/pip-install-un4mvgep/awscrt/build/deps/install', '-DCMAKE_INSTALL_PREFIX=/tmp/pip-install-un4mvgep/awscrt/build/deps/install', '-DBUILD_SHARED_LIBS=OFF', '-DCMAKE_BUILD_TYPE=RelWithDebInfo', '-DBUILD_TESTING=OFF', '-DCMAKE_INCLUDE_PATH="/usr/include/python3.6m"', '-DLibCrypto_INCLUDE_DIR=/tmp/pip-install-un4mvgep/awscrt/build/deps/libcrypto/include', '-DLibCrypto_STATIC_LIBRARY=/tmp/pip-install-un4mvgep/awscrt/build/deps/libcrypto/lib/libcrypto.a', '/tmp/pip-install-un4mvgep/awscrt/crt/s2n']' returned non-zero exit status 1.

ERROR: Failed building wheel for awscrt
Running setup.py clean for awscrt
Failed to build awscrt
Installing collected packages: awscrt, awsiotsdk
Running setup.py install for awscrt ... error
ERROR: Command errored out with exit status 1:
command: /usr/bin/python3 -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-un4mvgep/awscrt/setup.py'"'"'; __file__='"'"'/tmp/pip-install-un4mvgep/awscrt/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' install --record /tmp/pip-record-mbraawb4/install-record.txt --single-version-externally-managed --user --prefix= --compile --install-headers /home/grabitinigo/.local/include/python3.6m/awscrt
cwd: /tmp/pip-install-un4mvgep/awscrt/
Complete output (88 lines):
running install
running build
running build_py
creating build/lib.linux-aarch64-3.6
creating build/lib.linux-aarch64-3.6/awscrt
copying awscrt/auth.py -> build/lib.linux-aarch64-3.6/awscrt
copying awscrt/crypto.py -> build/lib.linux-aarch64-3.6/awscrt
copying awscrt/http.py -> build/lib.linux-aarch64-3.6/awscrt
copying awscrt/io.py -> build/lib.linux-aarch64-3.6/awscrt
copying awscrt/mqtt.py -> build/lib.linux-aarch64-3.6/awscrt
copying awscrt/__init__.py -> build/lib.linux-aarch64-3.6/awscrt
copying awscrt/exceptions.py -> build/lib.linux-aarch64-3.6/awscrt
copying awscrt/awsiot_mqtt_connection_builder.py -> build/lib.linux-aarch64-3.6/awscrt
running build_ext
cmake version 3.10.2

CMake suite maintained and supported by Kitware (kitware.com/cmake).
--- Building dependency: s2n (RelWithDebInfo) ---
cmake -DCMAKE_PREFIX_PATH=/tmp/pip-install-un4mvgep/awscrt/build/deps/install -DCMAKE_INSTALL_PREFIX=/tmp/pip-install-un4mvgep/awscrt/build/deps/install -DBUILD_SHARED_LIBS=OFF -DCMAKE_BUILD_TYPE=RelWithDebInfo -DBUILD_TESTING=OFF -DCMAKE_INCLUDE_PATH=\"/usr/include/python3.6m\" -DLibCrypto_INCLUDE_DIR=/tmp/pip-install-un4mvgep/awscrt/build/deps/libcrypto/include -DLibCrypto_STATIC_LIBRARY=/tmp/pip-install-un4mvgep/awscrt/build/deps/libcrypto/lib/libcrypto.a /tmp/pip-install-un4mvgep/awscrt/crt/s2n
-- Attempting to try_compile PQ ASM
-- PQ ASM try_compile failed - using generic C code for PQ crypto
-- LibCrypto Include Dir: /tmp/pip-install-un4mvgep/awscrt/build/deps/libcrypto/include
-- LibCrypto Shared Lib:  /usr/lib/aarch64-linux-gnu/libcrypto.so
-- LibCrypto Static Lib:  /tmp/pip-install-un4mvgep/awscrt/build/deps/libcrypto/lib/libcrypto.a
-- Configuring done
CMake Error at CMakeLists.txt:191 (add_library):
  Target "s2n" links to target "LibCrypto::Crypto" but the target was not
  found.  Perhaps a find_package() call is missing for an IMPORTED target, or
  an ALIAS target is missing?


CMake Error at CMakeLists.txt:239 (target_include_directories):
  Error evaluating generator expression:

    $<TARGET_PROPERTY:LibCrypto::Crypto,INTERFACE_INCLUDE_DIRECTORIES>

  Target "LibCrypto::Crypto" not found.


CMake Error at CMakeLists.txt:239 (target_include_directories):
  Error evaluating generator expression:

    $<TARGET_PROPERTY:LibCrypto::Crypto,INTERFACE_INCLUDE_DIRECTORIES>

  Target "LibCrypto::Crypto" not found.


CMake Error at CMakeLists.txt:191 (add_library):
  Target "s2n" links to target "LibCrypto::Crypto" but the target was not
  found.  Perhaps a find_package() call is missing for an IMPORTED target, or
  an ALIAS target is missing?


-- Generating done
-- Build files have been written to: /tmp/pip-install-un4mvgep/awscrt/build/deps/s2n
Traceback (most recent call last):
  File "<string>", line 1, in <module>
  File "/tmp/pip-install-un4mvgep/awscrt/setup.py", line 263, in <module>
    'boto3'
  File "/usr/lib/python3/dist-packages/setuptools/__init__.py", line 129, in setup
    return distutils.core.setup(**attrs)
  File "/usr/lib/python3.6/distutils/core.py", line 148, in setup
    dist.run_commands()
  File "/usr/lib/python3.6/distutils/dist.py", line 955, in run_commands
    self.run_command(cmd)
  File "/usr/lib/python3.6/distutils/dist.py", line 974, in run_command
    cmd_obj.run()
  File "/usr/lib/python3/dist-packages/setuptools/command/install.py", line 61, in run
    return orig.install.run(self)
  File "/usr/lib/python3.6/distutils/command/install.py", line 589, in run
    self.run_command('build')
  File "/usr/lib/python3.6/distutils/cmd.py", line 313, in run_command
    self.distribution.run_command(command)
  File "/usr/lib/python3.6/distutils/dist.py", line 974, in run_command
    cmd_obj.run()
  File "/usr/lib/python3.6/distutils/command/build.py", line 135, in run
    self.run_command(cmd_name)
  File "/usr/lib/python3.6/distutils/cmd.py", line 313, in run_command
    self.distribution.run_command(command)
  File "/usr/lib/python3.6/distutils/dist.py", line 974, in run_command
    cmd_obj.run()
  File "/tmp/pip-install-un4mvgep/awscrt/setup.py", line 179, in run
    self._build_dependency(lib)
  File "/tmp/pip-install-un4mvgep/awscrt/setup.py", line 162, in _build_dependency
    subprocess.check_call(cmake_args)
  File "/usr/lib/python3.6/subprocess.py", line 311, in check_call
    raise CalledProcessError(retcode, cmd)
subprocess.CalledProcessError: Command '['cmake', '-DCMAKE_PREFIX_PATH=/tmp/pip-install-un4mvgep/awscrt/build/deps/install', '-DCMAKE_INSTALL_PREFIX=/tmp/pip-install-un4mvgep/awscrt/build/deps/install', '-DBUILD_SHARED_LIBS=OFF', '-DCMAKE_BUILD_TYPE=RelWithDebInfo', '-DBUILD_TESTING=OFF', '-DCMAKE_INCLUDE_PATH="/usr/include/python3.6m"', '-DLibCrypto_INCLUDE_DIR=/tmp/pip-install-un4mvgep/awscrt/build/deps/libcrypto/include', '-DLibCrypto_STATIC_LIBRARY=/tmp/pip-install-un4mvgep/awscrt/build/deps/libcrypto/lib/libcrypto.a', '/tmp/pip-install-un4mvgep/awscrt/crt/s2n']' returned non-zero exit status 1.
----------------------------------------

ERROR: Command errored out with exit status 1: /usr/bin/python3 -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-un4mvgep/awscrt/setup.py'"'"'; __file__='"'"'/tmp/pip-install-un4mvgep/awscrt/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' install --record /tmp/pip-record-mbraawb4/install-record.txt --single-version-externally-managed --user --prefix= --compile --install-headers /home/grabitinigo/.local/include/python3.6m/awscrt Check the logs for full command output.

I've tried to execute with or without sudo -H.
Thanks for the help.

bug
Source
picture Sanrro10
👍1

All 16 comments

What OS are you using? What version of openssl do you have installed? To get open ssl version use openssl version -a

jmklix picture jmklix on 13 Oct 2020

Also have you tried the following:

Installation Issues

awsiotsdk depends on awscrt, which makes use of C extensions. Precompiled wheels are downloaded when installing on major platforms (Mac, Windows, Linux, Raspbian. If wheels are unavailable for your platform, your machine must compile some C libraries. If you encounter issues, install the following and try again:

sudo apt-get update
sudo apt-get install cmake
sudo apt-get install libssl-dev

jmklix picture jmklix on 13 Oct 2020

I have the exact same problem in Ubuntu 20.04 / aarch64 / Python 3.8 / OpenSSL 1.1.1f .

laszipt picture laszipt on 14 Oct 2020

I have tried this already, and my device is a Jetson nano. I have OpenSSL 1.1.1 installed, and I have tried to install with sudo -H python3 -m pip install awsiotsdk==1.5.0 and it worked, so I suppose its a problem with the latest release

Also have you tried the following:

Installation Issues
awsiotsdk depends on awscrt, which makes use of C extensions. Precompiled wheels are downloaded when installing on major platforms (Mac, Windows, Linux, Raspbian. If wheels are unavailable for your platform, your machine must compile some C libraries. If you encounter issues, install the following and try again:
sudo apt-get update
sudo apt-get install cmake
sudo apt-get install libssl-dev

Sanrro10 picture Sanrro10 on 14 Oct 2020
👍1

Running through the same steps as @Sanrro10 but with a Raspberry Pi I experience the same problem. Rolling back to v1.5.0 worked. Definitely a problem with v1.5.1.

boardthatpowder picture boardthatpowder on 15 Oct 2020

We are currently working on a fix, but this should only affect ARM platforms. For now, as @Sanrro10 figured out, you can just use the previous version 1.5.0. I will update this issue after the fix is published.

jmklix picture jmklix on 16 Oct 2020

I see the same issue installing an app with awsiotsdk as dependency in a trivial docker container.

  Building wheel for awscrt (setup.py): finished with status 'error'
  ERROR: Command errored out with exit status 1:
   command: /usr/local/bin/python -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-74gwxf0s/awscrt/setup.py'"'"'; __file__='"'"'/tmp/pip-install-74gwxf0s/awscrt/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' bdist_wheel -d /tmp/pip-wheel-jum46of1
       cwd: /tmp/pip-install-74gwxf0s/awscrt/
  Complete output (130 lines):
  running bdist_wheel
  running build
  running build_py
  creating build
  creating build/lib.linux-x86_64-3.8
  creating build/lib.linux-x86_64-3.8/awscrt
  copying awscrt/__init__.py -> build/lib.linux-x86_64-3.8/awscrt
  copying awscrt/io.py -> build/lib.linux-x86_64-3.8/awscrt
  copying awscrt/awsiot_mqtt_connection_builder.py -> build/lib.linux-x86_64-3.8/awscrt
  copying awscrt/crypto.py -> build/lib.linux-x86_64-3.8/awscrt
  copying awscrt/http.py -> build/lib.linux-x86_64-3.8/awscrt
  copying awscrt/auth.py -> build/lib.linux-x86_64-3.8/awscrt
  copying awscrt/exceptions.py -> build/lib.linux-x86_64-3.8/awscrt
  copying awscrt/mqtt.py -> build/lib.linux-x86_64-3.8/awscrt
  running build_ext
  cmake version 3.13.4

  CMake suite maintained and supported by Kitware (kitware.com/cmake).
  --- Building dependency: s2n (RelWithDebInfo) ---
  cmake -DCMAKE_PREFIX_PATH=/tmp/pip-install-74gwxf0s/awscrt/build/deps/install -DCMAKE_INSTALL_PREFIX=/tmp/pip-install-74gwxf0s/awscrt/build/deps/install -DBUILD_SHARED_LIBS=OFF -DCMAKE_BUILD_TYPE=RelWithDebInfo -DBUILD_TESTING=OFF -DCMAKE_INCLUDE_PATH=\"/usr/local/include/python3.8\" -DCMAKE_LIBRARY_PATH=\"/usr/local/lib\" -DLibCrypto_INCLUDE_DIR=/tmp/pip-install-74gwxf0s/awscrt/build/deps/libcrypto/include -DLibCrypto_STATIC_LIBRARY=/tmp/pip-install-74gwxf0s/awscrt/build/deps/libcrypto/lib/libcrypto.a /tmp/pip-install-74gwxf0s/awscrt/crt/s2n
  -- The C compiler identification is GNU 8.3.0
  -- Check for working C compiler: /usr/bin/cc
  -- Check for working C compiler: /usr/bin/cc -- works
  -- Detecting C compiler ABI info
  -- Detecting C compiler ABI info - done
  -- Detecting C compile features
  -- Detecting C compile features - done
  -- Looking for pthread.h
  -- Looking for pthread.h - found
  -- Looking for pthread_create
  -- Looking for pthread_create - not found
  -- Check if compiler accepts -pthread
  -- Check if compiler accepts -pthread - yes
  -- Found Threads: TRUE
  -- Attempting to try_compile PQ ASM
  -- The ASM compiler identification is GNU
  -- Found assembler: /usr/bin/cc
  -- PQ ASM try_compile succeeded - using optimized x86_64 assembly for PQ crypto
  -- Attempting to try_compile PQ ASM with ADX support
  -- PQ ASM try_compile with ADX support succeeded - using ASM code with ADX instructions
  -- Performing Test S2N_HAVE_EXECINFO
  -- Performing Test S2N_HAVE_EXECINFO - Success
  -- Found LibCrypto: /tmp/pip-install-74gwxf0s/awscrt/build/deps/libcrypto/lib/libcrypto.a
  -- LibCrypto Include Dir: /tmp/pip-install-74gwxf0s/awscrt/build/deps/libcrypto/include
  -- LibCrypto Shared Lib:  /usr/lib/x86_64-linux-gnu/libcrypto.so
  -- LibCrypto Static Lib:  /tmp/pip-install-74gwxf0s/awscrt/build/deps/libcrypto/lib/libcrypto.a
  -- Configuring done
  CMake Error at CMakeLists.txt:191 (add_library):
    Target "s2n" links to target "LibCrypto::Crypto" but the target was not
    found.  Perhaps a find_package() call is missing for an IMPORTED target, or
    an ALIAS target is missing?


  CMake Error at CMakeLists.txt:239 (target_include_directories):
    Error evaluating generator expression:

      $<TARGET_PROPERTY:LibCrypto::Crypto,INTERFACE_INCLUDE_DIRECTORIES>

    Target "LibCrypto::Crypto" not found.


  CMake Error at CMakeLists.txt:239 (target_include_directories):
    Error evaluating generator expression:

      $<TARGET_PROPERTY:LibCrypto::Crypto,INTERFACE_INCLUDE_DIRECTORIES>

    Target "LibCrypto::Crypto" not found.


  CMake Error at CMakeLists.txt:239 (target_include_directories):
    Error evaluating generator expression:

      $<TARGET_PROPERTY:LibCrypto::Crypto,INTERFACE_INCLUDE_DIRECTORIES>

    Target "LibCrypto::Crypto" not found.


  CMake Error at CMakeLists.txt:239 (target_include_directories):
    Error evaluating generator expression:

      $<TARGET_PROPERTY:LibCrypto::Crypto,INTERFACE_INCLUDE_DIRECTORIES>

    Target "LibCrypto::Crypto" not found.


  CMake Error at CMakeLists.txt:191 (add_library):
    Target "s2n" links to target "LibCrypto::Crypto" but the target was not
    found.  Perhaps a find_package() call is missing for an IMPORTED target, or
    an ALIAS target is missing?


  -- Generating done
  CMake Warning:
    Manually-specified variables were not used by the project:

      CMAKE_INCLUDE_PATH


  -- Build files have been written to: /tmp/pip-install-74gwxf0s/awscrt/build/deps/s2n
  Traceback (most recent call last):
    File "<string>", line 1, in <module>
    File "/tmp/pip-install-74gwxf0s/awscrt/setup.py", line 245, in <module>
      setuptools.setup(
    File "/usr/local/lib/python3.8/site-packages/setuptools/__init__.py", line 161, in setup
      return distutils.core.setup(**attrs)
    File "/usr/local/lib/python3.8/distutils/core.py", line 148, in setup
      dist.run_commands()
    File "/usr/local/lib/python3.8/distutils/dist.py", line 966, in run_commands
      self.run_command(cmd)
    File "/usr/local/lib/python3.8/distutils/dist.py", line 985, in run_command
      cmd_obj.run()
    File "/usr/local/lib/python3.8/site-packages/wheel/bdist_wheel.py", line 223, in run
      self.run_command('build')
    File "/usr/local/lib/python3.8/distutils/cmd.py", line 313, in run_command
      self.distribution.run_command(command)
    File "/usr/local/lib/python3.8/distutils/dist.py", line 985, in run_command
      cmd_obj.run()
    File "/usr/local/lib/python3.8/distutils/command/build.py", line 135, in run
      self.run_command(cmd_name)
    File "/usr/local/lib/python3.8/distutils/cmd.py", line 313, in run_command
      self.distribution.run_command(command)
    File "/usr/local/lib/python3.8/distutils/dist.py", line 985, in run_command
      cmd_obj.run()
    File "/tmp/pip-install-74gwxf0s/awscrt/setup.py", line 179, in run
      self._build_dependency(lib)
    File "/tmp/pip-install-74gwxf0s/awscrt/setup.py", line 162, in _build_dependency
      subprocess.check_call(cmake_args)
    File "/usr/local/lib/python3.8/subprocess.py", line 364, in check_call
      raise CalledProcessError(retcode, cmd)
  subprocess.CalledProcessError: Command '['cmake', '-DCMAKE_PREFIX_PATH=/tmp/pip-install-74gwxf0s/awscrt/build/deps/install', '-DCMAKE_INSTALL_PREFIX=/tmp/pip-install-74gwxf0s/awscrt/build/deps/install', '-DBUILD_SHARED_LIBS=OFF', '-DCMAKE_BUILD_TYPE=RelWithDebInfo', '-DBUILD_TESTING=OFF', '-DCMAKE_INCLUDE_PATH="/usr/local/include/python3.8"', '-DCMAKE_LIBRARY_PATH="/usr/local/lib"', '-DLibCrypto_INCLUDE_DIR=/tmp/pip-install-74gwxf0s/awscrt/build/deps/libcrypto/include', '-DLibCrypto_STATIC_LIBRARY=/tmp/pip-install-74gwxf0s/awscrt/build/deps/libcrypto/lib/libcrypto.a', '/tmp/pip-install-74gwxf0s/awscrt/crt/s2n']' returned non-zero exit status 1.
  ----------------------------------------
  ERROR: Failed building wheel for awscrt
sthysel picture sthysel on 16 Oct 2020

I have the same problem on Arch Linux, python 3.8, Openssl v.1.1.1h.

robertsarkozi picture robertsarkozi on 16 Oct 2020
👍1

Same problem here: docker image python:latest running on Raspberry Pi 4.
Versions in Container: Debian GNU/Linux 10 (buster), Python 3.9.0, Openssl 1.1.1d
Unfortunately also versions 1.5.0 ansd 1.4.0 do not work for me, it throws a differen error. See file attached..
Outside of the container (Raspbian) 1.5.0 works.
error_awsiotsdk.txt
Are there known errors with docker containers?
Edit: i found out that it is incomplatible with Python 3.9.0! using 3.8 it works.

sebastianBerryroad picture sebastianBerryroad on 16 Oct 2020

I am also having this issues. I am using a raspberry 3 model B with python 3.7.3.


Errors when running python3 -m pip install awsiotsdk and python3 -m pip install ./aws-iot-device-sdk-python-v2 

Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple
Processing /home/pi/aws-iot-device-sdk-python-v2
Collecting awscrt==0.9.3 (from awsiotsdk==1.0.0.dev0)
  Using cached https://files.pythonhosted.org/packages/83/2b/ad7fe011bb17baeb59f4a6e4b6f8b0e53da607b6cc2b50bf3e3c57624a7e/awscrt-0.9.3.tar.gz
Building wheels for collected packages: awsiotsdk, awscrt
  Running setup.py bdist_wheel for awsiotsdk ... done
  Stored in directory: /home/pi/.cache/pip/wheels/c2/c1/c8/34fc01d6902334ae9a2945b916990246499b722dfd1bfe1970
  Running setup.py bdist_wheel for awscrt ... error
  Complete output from command /usr/bin/python3 -u -c "import setuptools, tokenize;__file__='/tmp/pip-install-wejvufi4/awscrt/setup.py';f=getattr(tokenize, 'open', open)(__file__);code=f.read().replace('\r\n', '\n');f.close();exec(compile(code, __file__, 'exec'))" bdist_wheel -d /tmp/pip-wheel-5cp0qcot --python-tag cp37:
  running bdist_wheel
  running build
  running build_py
  creating build
  creating build/lib.linux-armv7l-3.7
  creating build/lib.linux-armv7l-3.7/awscrt
  copying awscrt/__init__.py -> build/lib.linux-armv7l-3.7/awscrt
  copying awscrt/awsiot_mqtt_connection_builder.py -> build/lib.linux-armv7l-3.7/awscrt
  copying awscrt/mqtt.py -> build/lib.linux-armv7l-3.7/awscrt
  copying awscrt/io.py -> build/lib.linux-armv7l-3.7/awscrt
  copying awscrt/exceptions.py -> build/lib.linux-armv7l-3.7/awscrt
  copying awscrt/crypto.py -> build/lib.linux-armv7l-3.7/awscrt
  copying awscrt/http.py -> build/lib.linux-armv7l-3.7/awscrt
  copying awscrt/auth.py -> build/lib.linux-armv7l-3.7/awscrt
  running build_ext
  cmake version 3.18.2

  CMake suite maintained and supported by Kitware (kitware.com/cmake).
  --- Building dependency: s2n (RelWithDebInfo) ---
  cmake -DCMAKE_PREFIX_PATH=/tmp/pip-install-wejvufi4/awscrt/build/deps/install -DCMAKE_INSTALL_PREFIX=/tmp/pip-install-wejvufi4/awscrt/build/deps/install -DBUILD_SHARED_LIBS=OFF -DCMAKE_BUILD_TYPE=RelWithDebInfo -DBUILD_TESTING=OFF -DCMAKE_INCLUDE_PATH=\"/usr/include/python3.7m\" -DLibCrypto_INCLUDE_DIR=/tmp/pip-install-wejvufi4/awscrt/build/deps/libcrypto/include -DLibCrypto_STATIC_LIBRARY=/tmp/pip-install-wejvufi4/awscrt/build/deps/libcrypto/lib/libcrypto.a /tmp/pip-install-wejvufi4/awscrt/crt/s2n
  -- The C compiler identification is GNU 8.3.0
  -- Detecting C compiler ABI info
  -- Detecting C compiler ABI info - done
  -- Check for working C compiler: /usr/bin/cc - skipped
  -- Detecting C compile features
  -- Detecting C compile features - done
  -- Looking for pthread.h
  -- Looking for pthread.h - found
  -- Performing Test CMAKE_HAVE_LIBC_PTHREAD
  -- Performing Test CMAKE_HAVE_LIBC_PTHREAD - Failed
  -- Check if compiler accepts -pthread
  -- Check if compiler accepts -pthread - yes
  -- Found Threads: TRUE
  -- Attempting to try_compile PQ ASM
  -- The ASM compiler identification is GNU
  -- Found assembler: /usr/bin/cc
  -- PQ ASM try_compile failed - using generic C code for PQ crypto
  -- Performing Test S2N_HAVE_EXECINFO
  -- Performing Test S2N_HAVE_EXECINFO - Success
  -- Found LibCrypto: /tmp/pip-install-wejvufi4/awscrt/build/deps/libcrypto/lib/libcrypto.a
  -- LibCrypto Include Dir: /tmp/pip-install-wejvufi4/awscrt/build/deps/libcrypto/include
  -- LibCrypto Shared Lib:  /usr/lib/arm-linux-gnueabihf/libcrypto.so
  -- LibCrypto Static Lib:  /tmp/pip-install-wejvufi4/awscrt/build/deps/libcrypto/lib/libcrypto.a
  -- Configuring done
  CMake Error at CMakeLists.txt:191 (add_library):
    Target "s2n" links to target "LibCrypto::Crypto" but the target was not
    found.  Perhaps a find_package() call is missing for an IMPORTED target, or
    an ALIAS target is missing?


  CMake Error at CMakeLists.txt:239 (target_include_directories):
    Error evaluating generator expression:

      $<TARGET_PROPERTY:LibCrypto::Crypto,INTERFACE_INCLUDE_DIRECTORIES>

    Target "LibCrypto::Crypto" not found.


  CMake Error at CMakeLists.txt:239 (target_include_directories):
    Error evaluating generator expression:

      $<TARGET_PROPERTY:LibCrypto::Crypto,INTERFACE_INCLUDE_DIRECTORIES>

    Target "LibCrypto::Crypto" not found.


  CMake Error at CMakeLists.txt:191 (add_library):
    Target "s2n" links to target "LibCrypto::Crypto" but the target was not
    found.  Perhaps a find_package() call is missing for an IMPORTED target, or
    an ALIAS target is missing?


  -- Generating done
  CMake Warning:
    Manually-specified variables were not used by the project:

      CMAKE_INCLUDE_PATH


  CMake Generate step failed.  Build files cannot be regenerated correctly.
  Traceback (most recent call last):
    File "<string>", line 1, in <module>
    File "/tmp/pip-install-wejvufi4/awscrt/setup.py", line 263, in <module>
      'boto3'
    File "/usr/lib/python3/dist-packages/setuptools/__init__.py", line 145, in setup
      return distutils.core.setup(**attrs)
    File "/usr/lib/python3.7/distutils/core.py", line 148, in setup
      dist.run_commands()
    File "/usr/lib/python3.7/distutils/dist.py", line 966, in run_commands
      self.run_command(cmd)
    File "/usr/lib/python3.7/distutils/dist.py", line 985, in run_command
      cmd_obj.run()
    File "/usr/lib/python3/dist-packages/wheel/bdist_wheel.py", line 188, in run
      self.run_command('build')
    File "/usr/lib/python3.7/distutils/cmd.py", line 313, in run_command
      self.distribution.run_command(command)
    File "/usr/lib/python3.7/distutils/dist.py", line 985, in run_command
      cmd_obj.run()
    File "/usr/lib/python3.7/distutils/command/build.py", line 135, in run
      self.run_command(cmd_name)
    File "/usr/lib/python3.7/distutils/cmd.py", line 313, in run_command
      self.distribution.run_command(command)
    File "/usr/lib/python3.7/distutils/dist.py", line 985, in run_command
      cmd_obj.run()
    File "/tmp/pip-install-wejvufi4/awscrt/setup.py", line 179, in run
      self._build_dependency(lib)
    File "/tmp/pip-install-wejvufi4/awscrt/setup.py", line 162, in _build_dependency
      subprocess.check_call(cmake_args)
    File "/usr/lib/python3.7/subprocess.py", line 347, in check_call
      raise CalledProcessError(retcode, cmd)
  subprocess.CalledProcessError: Command '['cmake', '-DCMAKE_PREFIX_PATH=/tmp/pip-install-wejvufi4/awscrt/build/deps/install', '-DCMAKE_INSTALL_PREFIX=/tmp/pip-install-wejvufi4/awscrt/build/deps/install', '-DBUILD_SHARED_LIBS=OFF', '-DCMAKE_BUILD_TYPE=RelWithDebInfo', '-DBUILD_TESTING=OFF', '-DCMAKE_INCLUDE_PATH="/usr/include/python3.7m"', '-DLibCrypto_INCLUDE_DIR=/tmp/pip-install-wejvufi4/awscrt/build/deps/libcrypto/include', '-DLibCrypto_STATIC_LIBRARY=/tmp/pip-install-wejvufi4/awscrt/build/deps/libcrypto/lib/libcrypto.a', '/tmp/pip-install-wejvufi4/awscrt/crt/s2n']' returned non-zero exit status 1.

  ----------------------------------------
  Failed building wheel for awscrt
  Running setup.py clean for awscrt
Successfully built awsiotsdk
Failed to build awscrt
Installing collected packages: awscrt, awsiotsdk
  Running setup.py install for awscrt ... error
    Complete output from command /usr/bin/python3 -u -c "import setuptools, tokenize;__file__='/tmp/pip-install-wejvufi4/awscrt/setup.py';f=getattr(tokenize, 'open', open)(__file__);code=f.read().replace('\r\n', '\n');f.close();exec(compile(code, __file__, 'exec'))" install --record /tmp/pip-record-cg6etnjd/install-record.txt --single-version-externally-managed --compile --user --prefix=:
    running install
    running build
    running build_py
    creating build/lib.linux-armv7l-3.7
    creating build/lib.linux-armv7l-3.7/awscrt
    copying awscrt/__init__.py -> build/lib.linux-armv7l-3.7/awscrt
    copying awscrt/awsiot_mqtt_connection_builder.py -> build/lib.linux-armv7l-3.7/awscrt
    copying awscrt/mqtt.py -> build/lib.linux-armv7l-3.7/awscrt
    copying awscrt/io.py -> build/lib.linux-armv7l-3.7/awscrt
    copying awscrt/exceptions.py -> build/lib.linux-armv7l-3.7/awscrt
    copying awscrt/crypto.py -> build/lib.linux-armv7l-3.7/awscrt
    copying awscrt/http.py -> build/lib.linux-armv7l-3.7/awscrt
    copying awscrt/auth.py -> build/lib.linux-armv7l-3.7/awscrt
    running build_ext
    cmake version 3.18.2

    CMake suite maintained and supported by Kitware (kitware.com/cmake).
    --- Building dependency: s2n (RelWithDebInfo) ---
    cmake -DCMAKE_PREFIX_PATH=/tmp/pip-install-wejvufi4/awscrt/build/deps/install -DCMAKE_INSTALL_PREFIX=/tmp/pip-install-wejvufi4/awscrt/build/deps/install -DBUILD_SHARED_LIBS=OFF -DCMAKE_BUILD_TYPE=RelWithDebInfo -DBUILD_TESTING=OFF -DCMAKE_INCLUDE_PATH=\"/usr/include/python3.7m\" -DLibCrypto_INCLUDE_DIR=/tmp/pip-install-wejvufi4/awscrt/build/deps/libcrypto/include -DLibCrypto_STATIC_LIBRARY=/tmp/pip-install-wejvufi4/awscrt/build/deps/libcrypto/lib/libcrypto.a /tmp/pip-install-wejvufi4/awscrt/crt/s2n
    -- Attempting to try_compile PQ ASM
    -- PQ ASM try_compile failed - using generic C code for PQ crypto
    -- LibCrypto Include Dir: /tmp/pip-install-wejvufi4/awscrt/build/deps/libcrypto/include
    -- LibCrypto Shared Lib:  /usr/lib/arm-linux-gnueabihf/libcrypto.so
    -- LibCrypto Static Lib:  /tmp/pip-install-wejvufi4/awscrt/build/deps/libcrypto/lib/libcrypto.a
    -- Configuring done
    CMake Error at CMakeLists.txt:191 (add_library):
      Target "s2n" links to target "LibCrypto::Crypto" but the target was not
      found.  Perhaps a find_package() call is missing for an IMPORTED target, or
      an ALIAS target is missing?


    CMake Error at CMakeLists.txt:239 (target_include_directories):
      Error evaluating generator expression:

        $<TARGET_PROPERTY:LibCrypto::Crypto,INTERFACE_INCLUDE_DIRECTORIES>

      Target "LibCrypto::Crypto" not found.


    CMake Error at CMakeLists.txt:239 (target_include_directories):
      Error evaluating generator expression:

        $<TARGET_PROPERTY:LibCrypto::Crypto,INTERFACE_INCLUDE_DIRECTORIES>

      Target "LibCrypto::Crypto" not found.


    CMake Error at CMakeLists.txt:191 (add_library):
      Target "s2n" links to target "LibCrypto::Crypto" but the target was not
      found.  Perhaps a find_package() call is missing for an IMPORTED target, or
      an ALIAS target is missing?


    -- Generating done
    CMake Generate step failed.  Build files cannot be regenerated correctly.
    Traceback (most recent call last):
      File "<string>", line 1, in <module>
      File "/tmp/pip-install-wejvufi4/awscrt/setup.py", line 263, in <module>
        'boto3'
      File "/usr/lib/python3/dist-packages/setuptools/__init__.py", line 145, in setup
        return distutils.core.setup(**attrs)
      File "/usr/lib/python3.7/distutils/core.py", line 148, in setup
        dist.run_commands()
      File "/usr/lib/python3.7/distutils/dist.py", line 966, in run_commands
        self.run_command(cmd)
      File "/usr/lib/python3.7/distutils/dist.py", line 985, in run_command
        cmd_obj.run()
      File "/usr/lib/python3/dist-packages/setuptools/command/install.py", line 61, in run
        return orig.install.run(self)
      File "/usr/lib/python3.7/distutils/command/install.py", line 589, in run
        self.run_command('build')
      File "/usr/lib/python3.7/distutils/cmd.py", line 313, in run_command
        self.distribution.run_command(command)
      File "/usr/lib/python3.7/distutils/dist.py", line 985, in run_command
        cmd_obj.run()
      File "/usr/lib/python3.7/distutils/command/build.py", line 135, in run
        self.run_command(cmd_name)
      File "/usr/lib/python3.7/distutils/cmd.py", line 313, in run_command
        self.distribution.run_command(command)
      File "/usr/lib/python3.7/distutils/dist.py", line 985, in run_command
        cmd_obj.run()
      File "/tmp/pip-install-wejvufi4/awscrt/setup.py", line 179, in run
        self._build_dependency(lib)
      File "/tmp/pip-install-wejvufi4/awscrt/setup.py", line 162, in _build_dependency
        subprocess.check_call(cmake_args)
      File "/usr/lib/python3.7/subprocess.py", line 347, in check_call
        raise CalledProcessError(retcode, cmd)
    subprocess.CalledProcessError: Command '['cmake', '-DCMAKE_PREFIX_PATH=/tmp/pip-install-wejvufi4/awscrt/build/deps/install', '-DCMAKE_INSTALL_PREFIX=/tmp/pip-install-wejvufi4/awscrt/build/deps/install', '-DBUILD_SHARED_LIBS=OFF', '-DCMAKE_BUILD_TYPE=RelWithDebInfo', '-DBUILD_TESTING=OFF', '-DCMAKE_INCLUDE_PATH="/usr/include/python3.7m"', '-DLibCrypto_INCLUDE_DIR=/tmp/pip-install-wejvufi4/awscrt/build/deps/libcrypto/include', '-DLibCrypto_STATIC_LIBRARY=/tmp/pip-install-wejvufi4/awscrt/build/deps/libcrypto/lib/libcrypto.a', '/tmp/pip-install-wejvufi4/awscrt/crt/s2n']' returned non-zero exit status 1.

    ----------------------------------------
Command "/usr/bin/python3 -u -c "import setuptools, tokenize;__file__='/tmp/pip-install-wejvufi4/awscrt/setup.py';f=getattr(tokenize, 'open', open)(__file__);code=f.read().replace('\r\n', '\n');f.close();exec(compile(code, __file__, 'exec'))" install --record /tmp/pip-record-cg6etnjd/install-record.txt --single-version-externally-managed --compile --user --prefix=" failed with error code 1 in /tmp/pip-install-wejvufi4/awscrt/

Tim-Jackins picture Tim-Jackins on 16 Oct 2020

I am also having this issue and my codebuild build project now fails (py 3.8), I posted the issue already at the awscrt repo https://github.com/awslabs/aws-crt-python/issues/192

burritoIand picture burritoIand on 16 Oct 2020

Same issue with raspberry 3 model B with python. Will rollback to v1.5

alozano-77 picture alozano-77 on 17 Oct 2020
👍1

@alozano-77 yeah I rolled back also to 1.5.0 for now, will revisit when it's fixed

burritoIand picture burritoIand on 17 Oct 2020

We refactored the cmake libcrypto finder recently and I suspect it’s related to that, will reach out to the team to have a look. Sorry for your troubles.

JonathanHenson picture JonathanHenson on 17 Oct 2020

This is fixed in 1.5.2

graebm picture graebm on 28 Oct 2020

⚠️COMMENT VISIBILITY WARNING⚠️

Comments on closed issues are hard for our team to see.
If you need more assistance, please either tag a team member or open a new issue that references this one.
If you wish to keep having a conversation with other community members under this issue feel free to do so.

github-actions[bot] picture github-actions[bot] on 28 Oct 2020
Was this page helpful?
0 / 5 - 0 ratings

Related issues

satay99 picture satay99  ·  6Comments
mkozjak picture mkozjak  ·  8Comments
qcabrol picture qcabrol  ·  8Comments
shravan097 picture shravan097  ·  6Comments
victorct-pronto picture victorct-pronto  ·  3Comments