Results 1 to 7 of 7

Thread: The impossibility of intelligence explosion

  1. #1

    The impossibility of intelligence explosion

    François Chollet
    Nov 27

    The impossibility of intelligence explosion

    ...

    Conclusions

    The expansion of intelligence can only come from a co-evolution of brains (biological or digital), sensorimotor affordances, environment, and culture — not from merely tuning the gears of some brain in a jar, in isolation. Such a co-evolution has already been happening for eons, and will continue as intelligence moves to an increasingly digital substrate. No “intelligence explosion” will occur, as this process advances at a roughly linear pace.

    Remember:

    - Intelligence is situational — there is no such thing as general intelligence. Your brain is one piece in a broader system which includes your body, your environment, other humans, and culture as a whole.
    - No system exists in a vacuum; any individual intelligence will always be both defined and limited by the context of its existence, by its environment. Currently, our environment, not our brain, is acting as the bottleneck to our intelligence.
    - Human intelligence is largely externalized, contained not in our brain but in our civilization. We are our tools — our brains are modules in a cognitive system much larger than ourselves. A system that is already self-improving, and has been for a long time.
    - Recursively self-improving systems, because of contingent bottlenecks, diminishing returns, and counter-reactions arising from the broader context in which they exist, cannot achieve exponential progress in practice. Empirically, they tend to display linear or sigmoidal improvement. In particular, this is the case for scientific progress — science being possibly the closest system to a recursively self-improving AI that we can observe.
    - Recursive intelligence expansion is already happening — at the level of our civilization. It will keep happening in the age of AI, and it progresses at a roughly linear pace.

    https://medium.com/@francois.chollet...n-5be4a9eda6ec
    I agree with much of what Chollet has said here. The only asterisk I would add is that we cannot rule out arbitrarily large "hockey-sticks" in the growth of AI at any given point. During such a period (say, right after a major breakthrough) it might seem that AI has transcended human intelligence and completely left us in the dust. But I think that, eventually, we will catch up with it because we will be able to track along with progress in AI by enhancing our own abilities. Think of it like consulting a chess engine to play against a chess engine. This has been tried and even though chess engines are unconditionally stronger than any human player, when a human player works with a chess engine against another chess engine, the human+computer team is stronger. So, the real dangers of AI lie in the distortions that can be made about what AI actually can and cannot do.



  2. Remove this section of ads by registering.
  3. #2
    Well, first women have to start $#@!ing more intelligent men.
    "He's talkin' to his gut like it's a person!!" -me
    "dumpster diving isn't professional." - angelatc


    "Each of us must choose which course of action we should take: education, conventional political action, or even peaceful civil disobedience to bring about necessary changes. But let it not be said that we did nothing." - Ron Paul

    "Paul said "the wave of the future" is a coalition of anti-authoritarian progressive Democrats and libertarian Republicans in Congress opposed to domestic surveillance, opposed to starting new wars and in favor of ending the so-called War on Drugs."

  4. #3
    Supporting Member
    North Korea
    Lamp's Avatar


    Blog Entries
    2
    Posts
    2,919
    Join Date
    Nov 2016
    Quote Originally Posted by dannno View Post
    Well, first women have to start $#@!ing more intelligent men.
    MMmmm doggystyle with Sheldon Cooper. I'm sure every woman would want that.
    「The Sanscrit language, whatever be its antiquity, is of a wonderful structure; more perfect than the Greek, more copious than the Latin, and more exquisitely refined than either, yet bearing to both of them a stronger affinity, both in the roots of verbs and the forms of grammar, than could possibly have been produced by accident;」.-Sir William Jones


  5. #4
    Quote Originally Posted by Lamp View Post
    MMmmm doggystyle with Sheldon Cooper. I'm sure every woman would want that.
    The world needs more Pennies.
    "He's talkin' to his gut like it's a person!!" -me
    "dumpster diving isn't professional." - angelatc


    "Each of us must choose which course of action we should take: education, conventional political action, or even peaceful civil disobedience to bring about necessary changes. But let it not be said that we did nothing." - Ron Paul

    "Paul said "the wave of the future" is a coalition of anti-authoritarian progressive Democrats and libertarian Republicans in Congress opposed to domestic surveillance, opposed to starting new wars and in favor of ending the so-called War on Drugs."

  6. #5
    Supporting Member
    North Korea
    Lamp's Avatar


    Blog Entries
    2
    Posts
    2,919
    Join Date
    Nov 2016
    Quote Originally Posted by dannno View Post
    The world needs more Pennies.
    I agree
    「The Sanscrit language, whatever be its antiquity, is of a wonderful structure; more perfect than the Greek, more copious than the Latin, and more exquisitely refined than either, yet bearing to both of them a stronger affinity, both in the roots of verbs and the forms of grammar, than could possibly have been produced by accident;」.-Sir William Jones


  7. #6
    Quote Originally Posted by ClaytonB View Post
    I agree with much of what Chollet has said here. The only asterisk I would add is that we cannot rule out arbitrarily large "hockey-sticks" in the growth of AI at any given point. During such a period (say, right after a major breakthrough) it might seem that AI has transcended human intelligence and completely left us in the dust. But I think that, eventually, we will catch up with it because we will be able to track along with progress in AI by enhancing our own abilities. Think of it like consulting a chess engine to play against a chess engine. This has been tried and even though chess engines are unconditionally stronger than any human player, when a human player works with a chess engine against another chess engine, the human+computer team is stronger. So, the real dangers of AI lie in the distortions that can be made about what AI actually can and cannot do.
    Sadly, I have a feeling there IS a hockey stick, but it is going the wrong way.
    1776 > 1984

    The FAILURE of the United States Government to operate and maintain an
    Honest Money System , which frees the ordinary man from the clutches of the money manipulators, is the single largest contributing factor to the World's current Economic Crisis.

    The Elimination of Privacy is the Architecture of Genocide

    Belief, Money, and Violence are the three ways all people are controlled

    Quote Originally Posted by Zippyjuan View Post
    Our central bank is not privately owned.

  8. #7
    relevant:
    Quote Originally Posted by Torchbearer
    what works can never be discussed online. there is only one language the government understands, and until the people start speaking it by the magazine full... things will remain the same.
    Hear/buy my music here "government is the enemy of liberty"-RP Support me on Patreon here Ephesians 6:12



Similar Threads

  1. Replies: 4
    Last Post: 03-21-2014, 11:36 AM
  2. Replies: 0
    Last Post: 03-28-2012, 12:15 PM
  3. The Impossibility of an informed electorate (article)
    By heavenlyboy34 in forum Open Discussion
    Replies: 0
    Last Post: 10-11-2010, 10:04 PM
  4. The impossibility of the State
    By heavenlyboy34 in forum Political Philosophy & Government Policy
    Replies: 5
    Last Post: 10-30-2009, 01:45 PM
  5. Prediction Markets: The Paul Impossibility?
    By jorlowitz in forum Grassroots Central
    Replies: 8
    Last Post: 07-17-2007, 02:31 PM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •