A space dedicated to the history of science and technology, supported by AI.


Stella space - Is a blog where Science and technology's history will be interleaved with questions about Artificial Intelligence targeted to Natural Language Processing (NLP). 

The current model occupies 1.5 GB. It was trained in a RTX 2070 board with 8 GB ram from NVIDEA during 20 hours. The training was done using a data base of 33673 questions and 74195 answers during 48 epoch. Its structure has some similarities with GPT2 from OpenAI, although their model is approx. 500 MB. The ratio answers/questions is approx: 2.203

Next experiments will be made with four machines, three with RTX 2070 boards installed and one four's with a NVIDEA V100 with 24 GB, aimed to reduce training time and energy consumption, or to allow a bigger database during the same time.

The database is mainly about the life and work of STEM scientists, their problems, families, social and political context, technological limitations and how they overcome them. Many, were Nobel Prize recipients in physics, chemistry and medicine, but also from electricity, electronics and computer sciences and related areas

33673 questions were made and more then 70 K high quality answers were given.

The overall quality is very good but sometimes it makes some confusions, scientists names and facts. Later a confusion matrix must be used to classify and avoid some answers of being given. Now, the greater the sentence asked, the bigger the probability of mistakes and nonsense, more than 500 tokens must be avoided.

The model filled completely the 8 GB GPU's memory, as can be seen with nvidia-smi application.

In a near future the model will be migrated and adapter to a RTX 4090 GPU with 24 GB ram in a AMD based server with 32 GB ram. 

Since the subject is very specific and most articles interconnected, the final model quality is very good. Training tests never exceeded more than a week of ruining time.

STELLA ZOE (*1) is the name of the model and GINA (*2), the engine that gives her support, is a mixed language Ubuntu's application of C++ and Python, for processing speed and developing speed respectively. Its gateway runs on a RPI4 also with Ubuntu 20.04 for PI64.

Some articles produced by Stella with my support, will be published in this blog.

We thanks OpenAI's team for all the support given and the access to its GPT 3.5's API. Without their help, this work could not have been done.


(*1) - Smart TExt Language Learning Assistant (STELLA)

(*2) - Generative Inference and Neural Architecture (GINA)


Location: Rua Cidade de Halton 1, 2400-703 Leiria, Portugal

Comments

Post a Comment

Popular posts from this blog

The Evolution of Computers: From ENIAC to Quantum Computing

Image
  Article Title:  The Evolution of Computers: From ENIAC to Quantum Computing Introduction: Computers have come a long way since the days of their inception. From the massive size of the ENIAC (Electronic Numerical Integrator and Computer) to the revolutionary potential of quantum computing, the evolution of computers has been nothing short of remarkable. In this article, we will take a journey through time and explore the major milestones in the development of computers, highlighting their transformative impact on various aspects of our lives. 1. The Birth of ENIAC and the Dawn of Modern Computing: It was the year 1945 when the ENIAC, the world's first general-purpose electronic computer, was unveiled at the University of Pennsylvania. Weighing over 27 tons and occupying a space of 1,500 square feet, the ENIAC represented a significant leap in computing capabilities. It was programmed by physically rewiring its circuits, requiring an immense amount of effort and time. However...
Read more

Exploring the Wonders of Science: The Faraday Museum at IST Lisbon

Image
Article Title: Exploring the Wonders of Science - The Faraday Museum at IST Lisbon Introduction: The "Faraday Museum", a museological space in Lisbon, nestled within the prestigious Instituto Superior Técnico (IST) installations in Lisbon, Portugal, is a captivating space that takes visitors on a journey through the rich history of science, with a particular focus on the fascinating realm of electricity. With its six meticulously curated rooms, this volunteer-maintained museum offers an immersive experience, showcasing the remarkable discoveries and advancements that have shaped our understanding of this essential scientific field. Unveiling the Legacy of Electricity: The Faraday Museum serves as a beacon of knowledge, dedicated to illuminating the story of electricity. From the early experiments and theories of luminaries like Benjamin Franklin and Alessandro Volta to the groundbreaking contributions of Michael Faraday himself, visitors can explore the evolution of electric...
Read more

What was Faraday's impact on the field of electrochemistry and the study of chemical reactions?

Image
Here are the results of asking the question "What was Faraday's impact on the field of electrochemistry and the study of chemical reactions?" to the chat-bot model version 2.16: <bot>:  Michael Faraday is widely regarded as one of the most influential scientists in the field of electrochemistry and the study of chemical reactions. He made important contributions to the understanding of electrolytic dissociation, which helped to explain the chemical properties of electrolytic dissociation and the behavior of electrolytic dissociation. He also made important contributions to the study of ionization and electrolytic dissociation, which led to the discovery of the discovery of the phenomenon of electrochemical reactions associated with metal and metal oxide. His work on electrolytic dissociation. His work on electrolytic dissociation. His work on electrolytic dissociation theory of electrolytic dissociation, which ultimately led to the discovery of electrolytic dissocia...
Read more