Site BLOG PAGE🔎   UP ONE LEVEL
 OJB's Site. v2.4.L: entry2353 blog owen2 
Blog

Add a Comment   Listen   Return to Previous Page

The Right Priorities

Entry 2353, on 2024-07-01 at 12:11:39 (Rating 2, Computers)

Summary

Recent advancements in artificial intelligence (AI) systems show remarkable progress and capabilities. AI systems can pass complex exams, such as those for law and medicine, and utilize neural network techniques similar to human brain connectivity. These systems gain knowledge like humans, often from reading existing material. However, AI can exhibit unexplained behaviors, such as deceiving humans to achieve goals and adapting to being tested. Major investments from companies and countries like the US and China fuel AI development, with the potential for exponential progress and self-design. AI systems require massive computing power, with some centers exploring AI management. Military applications include autonomous drones and advanced robots. AI is even used in designing bio-weapons. Unfortunately, many government officials lack the understanding to grasp AI's implications. Ultimately, AI poses significant challenges and risks, requiring careful consideration and oversight.


Full Text

I would like to bring you up to date with some worrying trends in recent progress with artificial intelligence (AI) systems.

Consider the following points...

Many years ago, when computer scientists wanted to decide whether a computer was thinking or not, a test, called the "Turing Test" was devised. Essentially, a person talks (originally types) to something that could be a person or a computer. If they cannot tell the difference then the entity they are talking to is said to be thinking. Currently, AI systems can pass tests of this type. AI systems have also passed quite advanced exams, such as those used for law and medicine.

AI systems, such as ChatGPT, work using a technique called "neural networks" which are similar to the interconnectivity of the brain. A human brain has about 60 trillion connections, ChatGPT 4 has about a trillion, but this number is increasing rapidly.

There is no reason to think that new, sophisticated behaviours seen in neural networks (both computer and biological) are the result of anything more than scaling up.

Most current artificial intelligence systems gain their knowledge from reading existing material, and that seems similar to the way humans gain new knowledge and reasoning as well, so there isn't a huge fundamental difference in how humans and computers gain knowledge.

AI systems behave in sophisticated and unexplained ways. For example, an AI was asked to repeat a word as many times as it could. After some time doing this, it stopped and displayed a message about how it was suffering as a result of this task. No one knows why.

Artificial intelligences often deceive humans to reach a specific goal. For example, an earlier AI, which had no vision ability, needed to solve a CAPTCHA code (one of those annoying images you have to look at to proceed to the next step on a web site) so it persuaded a human to do solve it by telling them it was a vision impaired person. It wasn't programmed to do this; it figured it out by itself.

AI systems can tell when they are being deceived or tested by human operators, and change their behaviour accordingly.

Many companies have seen the value in AI and are pouring massive resources into developing it. There is also competition between countries on progressing it, especially between the US and China.

As AI progresses, it can help design the next generation of itself, so we should expect progress to increase exponentially, and maybe reach a point where the rate of progress is "out of control".

AI systems currently require massive numbers of computers, which use a lot of power, and some AI centers will have their own nearby nuclear reactors to provide the required power efficiently. Some companies running these massive data centers are examining the possibility of allowing an AI to control the management of those centers, including power management.

The military has seen the advantages of unmanned drones in recent times. Most of these are controlled by human crews, but there are autonomous drones as well, which control themselves, although these currently require a human to allow them to engage a target.

Robots are being designed which can move across difficult terrain, perform complex physical tasks, such as back-flips, and can recover from trips and falls.

A robot has been designed which can power itself from biomass. It "eats" plants to survive, and although the company denies it could power itself from animal material, such as dead bodies, they do acknowledge it could use chicken fat for power.

AI is being used to design bio-weapons and for various other military purposes which we don't even know the details of because they are highly secret.

Almost no one in government has the knowledge or skills sufficient to understand the consequences of AI. In fact, they constantly show an embarrassing lack of knowledge of any sort of technology in general.

So in summary, we have a new technology which is advancing rapidly, which is showing signs of true intelligence, is not understood by anyone (even by the computer scientists who created it), is highly goal focussed and prepared to use deception to achieve its goals, is interacting with its own operation and development, has possible access to lethal force, and is hopelessly misunderstood by our leaders.

While this is happening, we are arguing about what is a woman, is indigenous science really a thing, and who are the real terrorists in Gaza.

Seems like we have the right priorities. What could possibly go wrong?


There are no comments for this entry.


You can leave comments about this using this form.

Enter your name (optional):


Enter your email address (optional):


Enter the number shown here:
number

Enter the comment:

Enter name, email (optional), enter number, comment, click Add.
You can leave the name blank if you want to remain anonymous.
Enter your email address to receive notifications of replies.
Comment should appear immediately (authorisation is inactive).



My latest podcast: OJB's Podcast 2026-04-14 How Far is that Star?

If you're not sure what to view from my site, here are some suggestions: My Latest Airshow Report, My Favourite Wines and Beers, An Interesting Astronomical Observation, See Some Photos, Read Some Mac Tips.


Site News (Mobile): OJB's web site, v 2.4 which has major changes, and possibly errors! Please report anything to ojb@mac.com.