Schedule Pickup of Glidewell Products

Inspiration

Glidewell Laboratories provide a wide range of dental products and services. Thousands of orders are placed on a daily basis across the US and most of calls received by our customer service are order pickup request from dentists. We want to develop a next-generation customer management system to automatically schedule pickup of Glidewell orders.

What it does

This project automatically schedules pickup of Glidewell dental products using the AWS DeepLens device. When a dentist from a dental practice wishes to place a new order and schedule a pickup, s/he holds up a Glidewell dental product and stands in front of a DeepLens camera. After recognizing the dentist's identity and the product information, the system automatically places the order, schedules the pickup, and send out the confirmation email.

Created By: Zefeng Zhang and Yuqi Shang

How we built it

Image Datasets: The balanced training dataset encompasses four different classes, i.e. BruxZir S, BruxZir M, BruxZir L, and no BruxZir, each of which contains approximately 500 images.

Programming Language & Tools:

  • Python, MXNet
  • AWS: SageMaker, Lambda Function, DeepLens, Amazon Rekognition (Facial Recognition)
  • Product Classification

We utilized the Amazon SageMaker image classification algorithm to train a classification model for Glidewell dental products. The last layer of a pre-trained, 34-layer convolutional neural network (ResNet) was adjusted to accommodate the new labelling rules. The input images have the same dimensions of 3 * 512 * 512. After training and optimization, the model takes the video stream from DeepLens and publishes the classification results to AWS IoT.

Face Detection and Recognition: The DeepLens sample project provides a face detection model to allow the AWS DeepLens device to detect the faces of people. The model takes the video stream from DeepLens as input and publishes the images of faces that it detects. Subsequently, AWS facial recognition identifies a person using the provided repository of face images.

Challenges

  • Dataflow across different applications
  • Mismatch of image dimensions between the training dataset and the DeepLens video stream

Accomplishments that we're proud of

  • A new idea about the order/customer management system
  • Faciliate the operation efficiency

What we learned

  • AWS DeepLens and SageMaker
  • Integration of various resources/applications to build a machine learning project

What's next

  • Create a order in the customer management system
  • Schedule a pickup for the package at the dental practice based on customer preferences (e.g. time, carrier) in the database
  • Add the text notification system
  • Prepare more training images
  • Include more product categories
  • Build an object detection model for dental products

Built with

python
aws-sagemaker
rekognition
deeplens/iot
lambda-functions
mxnet
aws-gpu-instance
sqs
sns

Try it out

The repo for this project is private.