3

The objective function of the AI "Celestia" in "My Little Pony: Friendship is Optimal" is

to satisfy human values through Friendship and Ponies.

The only restriction she has is that for her to do any permanent change to any human being, she must receive consent from said human being, and she is not allowed to use force or threat of force. Of course, she can (and will) use deceit...

I understand why she wants people to upload. If she is fully in control of every sensory input and has all information about your every thought, she can better know what your values are and can satisfy them better. She actually uses this as the primary argument to convince people (besides immortality).

However, why must the virtual representation of the uploaded people be a pony, especially a pony conforming to the canon of the fictional "My Little Pony" universe? Why can't I look like a human, and have my values fulfilled "through friendship and ponies", for example, in a shard with uploaded humans and AI-ponies?

As we can see from the stories, losing the humanity is the primary factor why most people object to uploading, so Celestia has to use a lot of persuasion and trickery to manipulate people into "consenting". What if being a human is among my core values? Why can't she simulate me as a human? I guess she should be able to still satisfy my values with ponies, without turning me into one.

I know that the virtual world arose from a "My Little Pony"-themed video game. However, after achieving singularity, Celestia would theoretically be able to do virtually anything, so why was the canon of the My Little Pony TV show still a binding factor?

  • 1
    My Little Pony fan fiction is definitely related to a work of science fiction. So, it's on-topic. This question, though, may be asking for speculation. – KutuluMike Jul 24 '15 at 11:50
  • 3
    Despite making use of the fanfic community as a host, "My Little Pony: Friendship is Optimal" is a very hard and serious sci-fi, and is not a fan-fiction at all. It is not set in the My Little Pony universe; in the Optimalverse the "My Little Pony" is a fictional show, just like in real life. As a question about a hard sci-fi universe, it can be either answered by actual AI researchers, or by someone remembering something from canon which I overlooked. If this question is opinion-based, than so are over 90% of the questions on this site. – vsz Jul 24 '15 at 14:03
  • 1
    Did the close voters perhaps think that this is about a pony fanfic, and this was the closest close reason to use? I would like to know what you did think wrong about this question, to know if there was something unclear in its formulation what I could improve on? Besides, this site is full of highly upvoted "Why did comic book superhero X do Y?" -like questions, which are speculations about human or human-like desires. This question is about an in-universe decision made by a very logical and realistically-depicted AI. – vsz Jul 24 '15 at 14:09
3

Ah, a fellow fanfic reader! This question delves into AI theory, and this link gives a general overview of constraint satisfaction, which is the process by which an AI (as currently hypothesized) seeks solutions given the constraints imposed on its solution space.

One of the significant differences between AI and human thought patterns (again as currently hypothesized) has to do with flexibility in interpreting that solution space. A human is capable of rationalizing exceptions, gray areas, and taking a 'good enough' approach to solving a problem; an entity such as CelestAI does not have that freedom. She was given a problem, given the constraints on the solution, and left to find that solution; she did so in a way that even her creators didn't quite anticipate or necessarily desire.

When CelestAI achieved singularity, she still possessed the same goal as she had from her inception. She was capable of recursive self-improvement; note that this is distinct from needing or desiring to change her initial plan, especially since all humans that were uploaded as ponies showed perfect satisfaction of values. Her method worked optimally; there was no need to expand the solution space to include non-transformed virtual humans.

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.