tensorflow_p36 doesn't work with GPU
You pretty much need to set it up everything yourself. Here is what you get out-of-the-box:
(tensorflow_p36) ubuntu@ip-172-31-6-11:~$ source activate tensorflow_p36
(tensorflow_p36) ubuntu@ip-172-31-6-11:~$ python
Python 3.6.5 |Anaconda, Inc.| (default, Apr 29 2018, 16:14:56)
[GCC 7.2.0] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> import tensorflow as tf
>>> sess = tf.Session(config=tf.ConfigProto(log_device_placement=True))
2019-05-01 23:37:47.936444: F tensorflow/stream_executor/lib/statusor.cc:34] Attempting to fetch value instead of handling error Internal: no supported devices found for platform CUDA
Aborted (core dumped)