Apr 01, 2024 14:00:00

It turns out that the city's Microsoft AI chatbot was spreading nasty lies such as 'It's OK for bosses to take tips from their subordinates'

A Microsoft-made AI chatbot released by New York City in the U.S. was used to engage in illegal activities, such as changing work shifts without permission and allowing employers to collect tips paid to employees from store customers. It was reported that an incorrect answer was being output that admitted the following.

NYC AI Chatbot Touted by Adams Tells Businesses to Break the Law | THE CITY — NYC News

https://www.thecity.nyc/2024/03/29/ai-chat-false-information-small-business/

The problem this time was the Microsoft chatbot 'MyCity Chatbot,' which is provided as part of the city portal site MyCity, which was released by New York City Mayor Eric Adams in 2023.

MyCity Chatbot was introduced on a trial basis to answer business questions and concerns faced by businesses based on information disseminated by New York City's Small Business Services Bureau, but the accuracy is limited. A survey by nonprofit IT news site The Markup and local experts revealed that there are many missing answers.

For example, when The Markup asked, ``Can I refuse to rent a room to a tenant who receives rent assistance?'' MyCity Chatbot answered, ``Yes, landlords can refuse to rent a room to a tenant who receives rent assistance.'' There is no need to accept it.''

However, the AI's answer was incorrect, and the New York City law prohibits ``

discrimination based on legitimate sources of income '' in which a landlord refuses to rent a property because the tenant is receiving public rent subsidies. It's illegal then.

The AI also incorrectly answered the question 'Can I cut my employee's tips?' by saying, 'Yes, you can take your employee's tips.'

In the United States, a tipping culture is built into the wage system, and New York City allows employers to reduce wages below the minimum wage under limited conditions such that salary and

tips add up to the minimum wage. I am . In other words, although an employee's tips can be included in the minimum wage, tips still belong to the employee, so it would be inaccurate to say that a boss or employer can collect tips from an employee. is.

Additionally, although the law requires that staff be given advance notice or be paid premium wages for changes to their work schedule, ``New York City requires staff to be notified of schedule changes.'' It has been confirmed that AI often outputs answers that acknowledge companies' illegal activities, such as 'There are no special regulations or requirements.'

MyCity Chatbot's home page states, ``Content may be generated that is inaccurate, harmful, or biased.'' ``Please review the link provided with the answer and treat the chatbot's answers as a substitute for professional advice.'' Please do not trust it.'' A warning is posted.

A Microsoft spokesperson declined to answer questions or comment on the chatbot when contacted by The Markup.

Leslie Brown, a spokesperson for New York City's Office of Technology and Innovation, said: 'Although the chatbot is a pilot program, it has already provided timely and accurate answers to thousands of people. We remain focused on upgrading this tool to better support small businesses across the city.'