Your build seems to fail at “numpy” for some reason. You have a Debian numpy package,
python3-numpy 1:1.12.1-3, which I assume is version 1.12.1-3, and a version installed via pip3 that is version 1.16.4. I would hope it uses the later version but it might be better to remove the Debian package (which I don’t have installed, BTW):
sudo apt-get purge python3-numpy
Second, as you can see from my own experience above, building pandas also builds numpy, python-dateutil, pytz and six, which have (already) successfully been installed. Do you know how they got there?
Finally, you probably need to install wheel (sudo apt-get install python3-wheel) for the job to complete.