From robotics to artificial intelligence, here's how Amazon gets its products to Houstonians in record time. Photo by Natalie Harms/InnovationMap

How Amazon's Houston fulfillment center uses AI technology and robotics to move millions of products

Prime time

Last summer, Amazon opened the doors to its North Houston distribution center — one of the company's 50 centers worldwide that uses automation and robotics to fulfill online orders.

The Pinto Business Park facility has millions of products in inventory across four floors. Products that are 25 pounds or less (nothing heavier is stocked at this location) pass through 20 miles of conveyor belts, 1,500 employees, and hundreds of robots.

The center also has daily tours open to the public. We recently visited to see for ourselves the process a product goes through at this Houston plant. From stowing to shipping, here's how packages go from your shopping cart to your front porch.

Starting with stowing 

Natalie Harms/InnovationMap

A product's first step in an Amazon facility is stowing. There's no categorization of the products — it's not like there's one floor for one type of item or anything.

"It's completely randomly stowed," says Donna Beadle, PR specialist for Amazon. "She could be stowing cat food on this floor, and so could somebody on floor two."

An Amazon employee would scan an item and stow it into an empty bin of her choosing — sort of. To prevent confusion, a light projected indicates bins that are off limits to stow the item. The light identifies bins that have similar products. Keeping similar products apart helps prevents mistakes for the employee who later pulls those items once its ordered.

The system also sees where the employee is putting each item, rather than having to scan each item and the bin as well. This is a newer feature — the facility originally opened with hand-held scanners.

"Our next generation workstation is that they don't have to hold that scanner — they have hands free," says Brenda Alford, regional communications manager at Amazon.

Robots on the move

Once the bins are fully stocked, the robot — which is the orange device on the bottom of the yellow bins — moves about the facility by scanning QR codes on the floor.

Should a product fall out, an employee wearing a special vest can enter to retrieve it. That vest will send off a signal to the robots, which will then decrease their speeds and come to a stop when the employee comes close.

"It's an extra measure of safety so that people can interact with the robots and feel safe," says Beadle.

Picking before packing

Natalie Harms/InnovationMap

Once an item is ordered, the bin with that item appears in the pick process at the center. The system tells the Amazon employee which item to grab and which bin to put it in. The bins will have products for multiple different orders — another employee later will separate it out later.

"Often we describe it as a symphony — our technology and our associates working together," Alford says, noting that sometimes the company might receive criticism about using robots over humans. "We can't do this without these humans.

Amazon employees receive their benefits from day one on the job, Beadle says, and they work four, 10-hour days a week.

"We feel like that way they have more time with their families — they get three days off versus two days off. And that gives them time to heal and rest up," she says.

Bin to bin and back again

Natalie Harms/InnovationMap

Once full, the Amazon associate will push the bin onto a series of conveyor belts. The whole facility has 20 miles of conveyor belts — much of which happens overhead.

The bins then zigzag toward the pack process, which is separated to different stations. There are single-product stations and multiple package stations. The system determines where the bin should go, and some stations pack products that are determined to need packing materials, while others do not.

Single-product packaging

Natalie Harms/InnovationMap

At the packing process, the Amazon employee is told which size box to assemble — he or she can grab a bigger box, but they can't select a smaller one. The tape dispenser doles out the correct size of tape for that box automatically.

Once packaged up, a sticker with a barcode is placed on the box. This code will later be used to print the label for shipping. At this point in the process, no personal information has been revealed to anyone. In fact, most packages leave the facility without any personal information being viewed by employees.

In an effort to reduce packing materials, some products are shipped in the container they came in. In that instance, the packer would just place the barcode sticker on the package before sending it on the conveyor belt.

"If we don't need another box for that product, we don't use one," Beadle says. "We work with companies to make that happen, so we don't have to use more boxes if we don't have to."

SLAM 


While the robotics aren't slamming labels on packages, the SLAM process (short for scan, label, apply and manifest) is the first step in the process that includes a customer's personal information. During this process, the barcode is scanned, the package is weighed, and the label is printed and affixed to the package using a puff of air.

A package might be automatically pulled from the line if something seems to be off in the package's weight.

"Say you bought toothpaste, and it says that toothpaste weighs 20 pounds, we know something's wrong," Beadle says. "Like maybe that it was a pack that didn't get separated."

If the package is kicked off, an Amazon associate, called a problem solver, will assess the situation and make it right before returning it to the conveyor belt.

Kicked into gear

Once labeled, all the packages are sent on their final conveyor belt ride. Using a scanning process, the packages are kicked by an automated foot that sends them into a line to be loaded into an Amazon truck.

If a package misses its chute the first time around, it makes the loop again. The system can tell if a package is caught in the loop for whatever reason, and a problem solver might be called to assess the situation.

Down the slide

Natalie Harms/InnovationMap

After being kicked off the belt, the package then slides down a spiral chute that, despite looking like a playground slide, is off limits to any humans wanting to keep their job.

"People ask if you can go down the slide, and we always say that on your last day of work," Beadle jokes.

On to the shipping process

Natalie Harms/InnovationMap

The packages leave the facility in Amazon trucks and head to one more pit stop before making it to the customer.

"They don't go directly to your house after this process," Beadle says. "They go to a sortation center."

This could mean a USPS or UPS stop, but it depends on where the customer lives.

Ad Placement 300x100
Ad Placement 300x600

CultureMap Emails are Awesome

Rice University lands $18M to revolutionize lymphatic disease detection

fresh funding

An arm of the U.S. Department of Health and Human Services has awarded $18 million to scientists at Rice University for research that has the potential to revolutionize how lymphatic diseases are detected and help increase survivability.

The lymphatic system is the network of vessels all over the body that help eliminate waste, absorb fat and maintain fluid balance. Diseases in this system are often difficult to detect early due to the small size of the vessels and the invasiveness of biopsy testing. Though survival rates of lymph disease have skyrocketed in the United States over the last five years, it still claims around 200,000 people in the country annually.

Early detection of complex lymphatic anomalies (CLAs) and lymphedema is essential in increasing successful treatment rates. That’s where Rice University’s SynthX Center, directed by Han Xiao and Lei Li, an assistant professor of electrical and computer engineering, comes in.

Aided by researchers from Texas Children’s Hospital, Baylor College of Medicine, the University of Texas at Dallas and the University of Texas Southwestern Medical Center, the center is pioneering two technologies: the Visual Imaging System for Tracing and Analyzing Lymphatics with Photoacoustics (VISTA-LYMPH) and Digital Plasmonic Nanobubble Detection for Protein (DIAMOND-P).

Simply put, VISTA-LYMPH uses photoacoustic tomography (PAT), a combination of light and sound, to more accurately map the tiny vessels of the lymphatic system. The process is more effective than diagnostic tools that use only light or sound, independent of one another. The research award is through the Advanced Research Projects Agency for Health (ARPA-H) Lymphatic Imaging, Genomics and pHenotyping Technologies (LIGHT) program, part of the U.S. HHS, which saw the potential of VISTA-LYMPH in animal tests that produced finely detailed diagnostic maps.

“Thanks to ARPA-H’s award, we will build the most advanced PAT system to image the body’s lymphatic network with unprecedented resolution and speed, enabling earlier and more accurate diagnosis,” Li said in a news release.

Meanwhile, DIAMOND-P could replace the older, less exact immunoassay. It uses laser-heated vapors of plasmonic nanoparticles to detect viruses without having to separate or amplify, and at room temperature, greatly simplifying the process. This is an important part of greater diagnosis because even with VISTA-LYMPH’s greater imaging accuracy, many lymphatic diseases still do not appear. Detecting biological markers is still necessary.

According to Rice, the efforts will help address lymphatic disorders, including Gorham-Stout disease, kaposiform lymphangiomatosis and generalized lymphatic anomaly. They also could help manage conditions associated with lymphatic dysfunction, including cancer metastasis, cardiovascular disease and neurodegeneration.

“By validating VISTA-LYMPH and DIAMOND-P in both preclinical and clinical settings, the team aims to establish a comprehensive diagnostic pipeline for lymphatic diseases and potentially beyond,” Xiao added in the release.

The ARPA-H award funds the project for up to five years.

Houston doctor wins NIH grant to test virtual reality for ICU delirium

Virtual healing

Think of it like a reverse version of The Matrix. A person wakes up in a hospital bed and gets plugged into a virtual reality game world in order to heal.

While it may sound far-fetched, Dr. Hina Faisal, a Houston Methodist critical care specialist in the Department of Surgery, was recently awarded a $242,000 grant from the National Institute of Health to test the effects of VR games on patients coming out of major surgery in the intensive care unit (ICU).

The five-year study will focus on older patients using mental stimulation techniques to reduce incidences of delirium. The award comes courtesy of the National Institute on Aging K76 Paul B. Beeson Emerging Leaders Career Development Award in Aging.

“As the population of older adults continues to grow, the need for effective, scalable interventions to prevent postoperative complications like delirium is more important than ever,” Faisal said in a news release.

ICU delirium is a serious condition that can lead to major complications and even death. Roughly 87 percent of patients who undergo major surgery involving intubation will experience some form of delirium coming out of anesthesia. Causes can range from infection to drug reactions. While many cases are mild, prolonged ICU delirium may prevent a patient from following medical advice or even cause them to hurt themselves.

Using VR games to treat delirium is a rapidly emerging and exciting branch of medicine. Studies show that VR games can help promote mental activity, memory and cognitive function. However, the full benefits are currently unknown as studies have been hampered by small patient populations.

Faisal believes that half of all ICU delirium cases are preventable through VR treatment. Currently, a general lack of knowledge and resources has been holding back the advancement of the treatment.

Hopefully, the work of Faisal in one of the busiest medical cities in the world can alleviate that problem as she spends the next half-decade plugging patients into games to aid in their healing.