Artificial intelligence gives doctors a hand

An automated system dispenses medicine for patients at Affiliated Fuyang Hospital of Anhui Medical University, in Fuyang, Anhui province. [Photo/Xinhua]

BEIJING — Anhui Provincial Hospital became China’s first intelligent hospital in August, using artificial intelligence-enabled systems to help doctors with medical diagnoses and treatment.

Four months later, the hospital, in Hefei, Anhui’s provincial capital, was renamed the First Affiliated Hospital of University of Science and Technology of China.

Yan Guang, the hospital’s deputy head and the man in charge of its intelligent transformation, said that when it launched an AI-enabled smartphone application in 2016, doctors and nurses were keen to use it.

Developed by iFlytek, an AI company based in Hefei, the system uses speech-recognition technology to type up medical records and image-recognition technology to help doctors read medical images.

“The users of the app, which is a tailored edition for the hospital, soon reached a satisfying number,” Yan said. “Then we found there were also nurses among the users, while the system was designed to serve doctors.

“Nice numbers are definitely not all we want. It is the doctors using the app who can help the system improve.”

He said he subsequently had to limit use of the app among nurses.

Doctors said the AI-enabled systems have made their work more effective and efficient, although there are still some problems to overcome.

Qi Yinbao said that in his first four years as a neurosurgeon at the hospital, beginning in 2013, he had to spend much of his time writing up patients’ medical records every day.

“I usually wrote them between surgeries, and very often would stay in the office after working hours to finish them,” he said. “Sometimes I found I forgot some important information and needed to go through all the print records of examination results to refresh my memory.”

With the app developed by iFlytek, Qi and the hospital’s more than 1,300 doctors now have speech-recognition technology to help them record their diagnoses.

Special dictionary

To open the app, Qi can log in with either a fingerprint or a combination of face and voice recognition. He then just speaks into his smartphone and the app types up the information precisely.

Because doctors use many professional medical terms, iFlytek engineers said they built a special dictionary to make speech recognition more precise.

“The system also features deep learning technology, which means the more doctors use the system, the more precise the results will be,” said Lu Xiaoliang, deputy general manager of iFlytek’s intelligent healthcare business.

Some senior medical specialists found typing up records on a computer tedious, so the hospital previously had to arrange an assistant for each of them.

“With AI technology, the senior experts can now also work alone well, saving a lot of human resources for the hospital,” Yan said.

Qi said the speech-recognition technology could help dentists even more, as they were not able to spare a hand to write up records when working on patients’ teeth.

“They just need to keep the speech-recognition function working,” Qi said.

The function also works on a computer with a microphone, but it keeps typing as Qi keeps speaking, even though some of the things he says have nothing to do with his diagnosis, and he needs to delete them when he ends the recording.

That could prevent a dentist from chatting with a patient to relieve their anxiety, because there would be too much information to delete afterward.

The results of certain examinations of patients are automatically entered into the app, allowing Qi to check them anytime, anywhere.

“In the past, before making ward rounds to the patients’ rooms, we were first offered many print records and then asked the patients about their health conditions and took notes before returning to the office to type on computer-based systems”, Qi said.

But part of the preparatory work can now be done ahead of time, even when a doctor is on a bus or subway train.

Yan said a more important feature of the system is that it can help doctors read medical images to speed up diagnosis and prevent misdiagnosis.

Take CT scans for example. A doctor could spend minutes reading a CT case, which usually consists of many－sometimes hundreds－of images, before making an initial diagnosis, but Lu said it takes less than a second for the AI system to do the same thing.

“Best of all, the system won’t get tired,” he said.

The AI-enabled system has helped interpret thousands of CT images, Lu said, and the accuracy for detection of lung nodules, one of the indicators of potential lung cancer, has reached 99.4 per cent.

To build the intelligent hospital, Yan said several AI-enabled systems have been launched since 2016 in co-operation with iFlytek and other firms, including internet giants Alibaba and Tencent.

“None of the systems can work perfectly, but in the long run they will improve over time,” he said. “The medical sector will inevitably become more intelligent, and we cannot miss the chance to lead the trend.”

The hospital has not paid iFlytek a penny since they began co-operating in 2016.

“They don’t need to,” said Chen Liang, an iFlytek employee who leads a team of more than 10 engineers working in the hospital. “It will be by learning from the hospital what they really need that we can develop better systems.”

Yan is prudent when discussing the potential of AI-enabled systems, but they are already helping to guide patients around the hospital and allowing it to link up with hospitals around the province.

Another example is work on an intelligent emergency medical system.

“Once you call the emergency centre for first aid, your health information, based on all of your hospital records, will be provided to the first-aid personnel in the ambulance and doctors at the hospital,” said Yan, who was in charge of the hospital’s emergency medical centre from 2004 to 2007.

All the necessary advice on tailored first-aid solutions will be given to the medical personnel through the AI technology and they will see the advice via a smartphone app, he said.

The hospital has invested millions of yuan in the project, just dealing with its own medical records, and Yan said expanding the practice will require more effort.

The provincial authorities have launched a plan to build personal healthcare profiles, which can be shared between hospitals, for every citizen, and the project is progressing well, he said.

Intelligent healthcare is becoming a trend in hospitals. Hefei has also established a municipal-level intelligent hospital and the provincial authorities plan to set up six more at the provincial level and at least 15 at the municipal level this year.

First standard

Gao Junwen, deputy head of the Anhui Provincial Health Commission, said there must be some standards hospitals can refer to.

To build an intelligent hospital, the USTC hospital released its own 47 pages of standards, which won recognition from the provincial authorities. “It is the country’s first official standard for intelligent hospitals, and the national standard is expected to be drawn up using this one as an important reference,” Gao said.

Yan said there should be standards for different levels of intelligent hospital. “A county level intelligent hospital can by no means be built with a standard for a provincial-level one,” he said.

A recent article in the journal Chinese Digital Medicine, which is published by the National Health Commission, said there are still some technical difficulties to overcome in applying speech-recognition technology in diagnosis and treatment.

Written by a team of doctors from the General Hospital of the Guangzhou Command of the People’s Liberation Army, the article said background noise and doctors’ accents could affect the accuracy of the recognition process.

Speaking about a patient’s health conditions in an office shared by several doctors also failed to protect the patient’s privacy, it said, adding that solving the problem requires more investment to rearrange doctors’ offices by, for example, giving them more private space.

As the intelligent healthcare business heats up, Lu said competition between companies is getting fiercer.

“Some of the firms act as if they can change the world overnight, while we believe making healthcare intelligent still needs great efforts to improve technology,” Lu said.

“In the past, say about two years ago, some medical experts were too cautious about the business while some others’ opinions on it were too negative.

“Nowadays, their understanding of the business is getting more rational－the current technologies are not perfect but they can be improved.”

He said the business is very reliant on government support, because the authorities are always very cautious about the healthcare sector.