As far as being tweaked to please the target audience, just remember the hilarious Google AI debacle with the black female Founding Fathers and Asian WW2 Nazi soldiers. That was tweaked to please the racist/sexist Google management that were guiding the project.
In addition to being tweaked to please the target audience, they are trained on false data as well. The next round of training will be using fake data produced by the current AI, for 2nd-level garbage-in-garbage-out.
it is built to manipulate. hello big tech overlords.