More accurate coding: Researchers Talkon Monte Carlo serial

Coding continues with the help of artificial intelligence models Popular acquisition, but many have High problems This arises when developers depend on coding assistants.

However, researchers from Massachusetts Institute of Technologyand McGill Universityand Eth Zurichand Jones Hopkins Universityand Yelle and Mila-Kaibak artificial intelligence A new way to ensure that the symbols created from artificial intelligence are developed more accurate and useful. This method extends different programming languages ​​and directing the Great Language Model (LLM) to adhere to the rules of each language.

The group found that by adapting new samples methods, artificial intelligence models can be directed to follow programming grammar and even enhance the performance of small language models (SLMS), which are usually used to generate the code, and bypassing the large linguistic models model.

in paperSMC researchers used “SMC)” treatment of a number of difficult semantic analysis problems, and guiding generation with increased fixed and dynamic analysis. ” The serial Monte Carlo points to a family of algorithms that help know solutions to liquidate problems.

Joao Lula, co -author of the paper, said in an interview with The Massachusetts Institute of Technology This method “can improve programming assistants, acting data analysis and scientific discovery tools.” It can also reduce account costs and be more efficient than re -navigation methods.

The researchers pointed out that the code created from artificial intelligence can be strong, but it can also lead to a symbol that ignores the semantic rules of programming languages. Other ways to prevent this can distort models or take a very long time.

Their method makes LLM adhere to the rules of programming language by getting rid of the outputs of the programming instructions that may not work early in the process and “allocate efforts towards the outputs that are likely to be valid and accurate.”

SMC air conditioning to generate code

The researchers developed a structure that brings SMC to generate the “within a variety of grammatical and semantic restrictions.”

“Unlike many previous frameworks for restricted coding, our algorithm can integrate restrictions that are increasingly evaluated on the entire symbolic vocabulary, as well as restrictions that can only be evaluated at irregular periods during the generation,” the paper.

The main features of adapting SMC samples include the generation of models to distribute the suggestion where symbolic samples are directed through cheap restrictions, important weights that correct prejudices and re -samples that restore the effort of calculating partial generations.

The researchers noted that although SMC can direct models towards a more healthy and useful symbol, they admitted that the method may face some problems.

“Although taking important samples deals with many shortcomings in the decoding of local transparency, they also suffer from a great weakness: Weight corrections and expensive capabilities are not integrated except after generating a full sequence of the proposal. This is although the important information about whether the sequence can satisfy any restrictions early in many cases and can be used to avoid large amounts of uneven account.” They said.

Form test

To prove their theory, Lula and his team had experiments to see if the SMC use of the engineer was more accurate.

These experiences were:

• Bethon code generating database tasks, which used Llama 3 70B to cherish a line separately and test early versions
• Text generation to SQL with Llama 3 8B- Guidance
• Inference the goal in planning tasks to predict the status of the agent, as well as the use of Llama 3 8B
• The molecular synthesis of drug discovery

They found that the use of SMC models, improved accuracy and durability, and outperformed the larger models.

Why is it important

Artificial intelligence models have made engineers and other programmers work faster and more efficient. It is also present to a completely new type of software engineer: Program. but There were concerns On the quality of the code, the lack of support for the most complex coding and calculating the costs of generating the simple code.

New roads, such as SMC air conditioning, may make the same use of Amnesty International and enable engineers to trust the code resulting from the models more.

Other companies explore ways to improve the code created by artificial intelligence. Together, Amnesty International and agent Absolute Deepcoder-14BThat mocked fewer parameters. Google It also improves it The symbol help feature To help improve the quality of the code.

Daily visions about business use cases with VB daily

If you want to persuade your boss at work, you have covered VB Daily. We give you the internal journalistic precedence over what companies do with obstetric artificial intelligence, from organizational transformations to practical publishing operations, so that you can share visions of the maximum return on investment.

Read with us privacy policy

Thanks for subscribing. Check more VB news bulletins here.

An error occurred.