Free Republic
Browse · Search
Bloggers & Personal
Topics · Post Article

Skip to comments.

This AI Can Create Software Based On Screenshots
Ubergizmo ^ | May 29, 2017 | Tyler Lee

Posted on 05/29/2017 7:36:44 PM PDT by 2ndDivisionVet

It is often said that in the future, jobs that were once done by humans could eventually be taken over by robots who are admittedly more efficient due to their lack of the need to rest, take breaks, and sleep. While there are some jobs that are obvious in terms of robots being better at it, there are some that are less obvious, such as the job of a programmer.

However a Danish startup by the name of Ulzard Technologies IVS could change that, thanks to their development of AI dubbed pix2code that can help to program applications based on just screenshots. Basically what this means is that all users need to do is feed the AI with screenshots of what they want their program to look like, and it will then be able to generate code off of that.

In some ways it is more efficient than humans because it can code for multiple platforms, such as Android, iOS, and “web-based technologies”, whereas not all human developers are fluent in multiple languages and platforms, which is why multiple humans are sometimes needed for a job.

For those interested, you can check out the video above which shows the AI in action. The company’s founder Tony Beltramelli has also shared some details about the AI on GitHub and plans to make the source code available later this year.


TOPICS: Business/Economy; Computers/Internet; Science
KEYWORDS: computers; programming; robots; software
Navigation: use the links below to view more comments.
first 1-2021-22 next last
Not being a techie I have no idea if this is a breakthrough or ho-hum.
1 posted on 05/29/2017 7:36:45 PM PDT by 2ndDivisionVet
[ Post Reply | Private Reply | View Replies]

To: 2ndDivisionVet
(Laughs Nervously)

What KIND of software?........

2 posted on 05/29/2017 7:39:17 PM PDT by KC_Lion (Proud Keeper of the Sarah Palin and New First Lady Melania Ping Lists. Let me know if you want on.)
[ Post Reply | Private Reply | To 1 | View Replies]

To: 2ndDivisionVet

Well there goes MY job.....


3 posted on 05/29/2017 7:40:35 PM PDT by GraceG ("It's better to have all the Right Enemies, that it is to have all the Wrong Friends.")
[ Post Reply | Private Reply | To 1 | View Replies]

To: 2ndDivisionVet

Of course now all we need is software that automatically generates the screenshots...


4 posted on 05/29/2017 7:44:53 PM PDT by bigbob (People say believe half of what you see son and none of what you hear - M. Gaye)
[ Post Reply | Private Reply | To 1 | View Replies]

To: GraceG
You could always switch to testing

Think of all the cake you could have.

Oh crap, that meme played out four years ago huh?

5 posted on 05/29/2017 7:45:41 PM PDT by KC_Lion (Proud Keeper of the Sarah Palin and New First Lady Melania Ping Lists. Let me know if you want on.)
[ Post Reply | Private Reply | To 3 | View Replies]

To: KC_Lion

You will be able to see it on GitHub later this year.


6 posted on 05/29/2017 7:52:59 PM PDT by topspinr
[ Post Reply | Private Reply | To 2 | View Replies]

To: 2ndDivisionVet

Any software generated with the very limited information accorded by a screenshot is hardly worth the time to comment on.


7 posted on 05/29/2017 7:57:49 PM PDT by The Duke ( Azealia Banks)
[ Post Reply | Private Reply | To 1 | View Replies]

To: KC_Lion

Free Cake, I’m in!

Do I get a jumpsuit?


8 posted on 05/29/2017 7:59:02 PM PDT by GraceG ("It's better to have all the Right Enemies, that it is to have all the Wrong Friends.")
[ Post Reply | Private Reply | To 5 | View Replies]

To: GraceG

A Jumpsuit and Longfall Boots. :)


9 posted on 05/29/2017 8:02:25 PM PDT by KC_Lion (Proud Keeper of the Sarah Palin and New First Lady Melania Ping Lists. Let me know if you want on.)
[ Post Reply | Private Reply | To 8 | View Replies]

To: 2ndDivisionVet

Robots taking all the jobs will have a very bad ending. Surplus populations will have to be disposed of. They’re already getting people used to the idea with abortion and euthanasia.


10 posted on 05/29/2017 8:02:42 PM PDT by fella ("As it was before Noah so shall it be again,")
[ Post Reply | Private Reply | To 1 | View Replies]

To: 2ndDivisionVet

I am a techie, of sorts, and I also have no idea if this is a breakthrough or ho-hum. On the surface, it seems to be able to program a graphical user interface based on a picture. That’s something, I guess, but you’d still have to program what the interface interfaces to, which is generally where the fun really starts.


11 posted on 05/29/2017 8:04:32 PM PDT by rightwingcrazy (rightwingcrazy)
[ Post Reply | Private Reply | To 1 | View Replies]

To: 2ndDivisionVet

Novel idea. And yeah it’s doable.


12 posted on 05/29/2017 8:15:38 PM PDT by Red Steel
[ Post Reply | Private Reply | To 1 | View Replies]

To: 2ndDivisionVet

The future jobs and wars will be done by robots and AI, while humans will be phased out.

Oh, wait, that’s the plot for Terminator.


13 posted on 05/29/2017 8:30:01 PM PDT by sagar
[ Post Reply | Private Reply | To 1 | View Replies]

To: The Duke

sounds like a new version of screen scraping to me.


14 posted on 05/29/2017 8:36:35 PM PDT by thinkliberty64
[ Post Reply | Private Reply | To 7 | View Replies]

To: fella

“Surplus populations will have to be disposed of. They’re already getting people used to the idea with abortion and euthanasia.”

No need to do anything proactive. Each generation is 20-30 years. If you can get a couple of generations to have babies at below replacement levels, the population will simply vanish. Just old men and women after their menopause. Just die out.

The resistance is from the Muslims. Once they sign up for this, humans will have been effectively replaced. The quality off life from technology will be awesome for those old remaining folks.

Also, genetic engineering will not require traditional modes of reproduction.


15 posted on 05/29/2017 8:37:03 PM PDT by sagar
[ Post Reply | Private Reply | To 10 | View Replies]

To: 2ndDivisionVet

Basically what this means is that all users need to do is feed the AI with screenshots of what they want their program to look like, and it will then be able to generate code off of that.


The presentation layer is *not* a complete application system.


16 posted on 05/29/2017 8:43:39 PM PDT by Flick Lives ("Daddy, what did you do in the Deep State War?")
[ Post Reply | Private Reply | To 1 | View Replies]

To: The Duke

Somebody will have to generate production quality screens and configure the workflow and nuances. Perhaps a little scripting involve to make it do just right.

The end result will still be a software. A screen-driven programming, just like a myriad of *-driven programming languages and frameworks we have now.


17 posted on 05/29/2017 8:44:40 PM PDT by sagar
[ Post Reply | Private Reply | To 7 | View Replies]

To: KC_Lion

You ever see Weird Science? Get your vintage Kelly LeBrock pics handy.


18 posted on 05/29/2017 8:48:53 PM PDT by Rastus
[ Post Reply | Private Reply | To 2 | View Replies]

To: topspinr
> You will be able to see it on GitHub later this year.

https://github.com/tonybeltramelli/pix2code

19 posted on 05/29/2017 8:57:43 PM PDT by SecondAmendment (Restoring our Republic at 9.8357x10^8 FPS)
[ Post Reply | Private Reply | To 6 | View Replies]

To: 2ndDivisionVet

I am a programmer and do not regard this as a breakthrough. Generating some code from a screen design is nothing new and at best controls the user interaction with that one screen, to collect input or display output. No AI program is going to anticipate the background processes needed to unify a number of screens to produce an application of a specific purpose. It would rudimentary and extremely generic at best.

I have examined code produced by an application generator - it is bloated, overly complex and fragile to changes. I can write superior and maintainable code from scratch. There will always be a need for programmers; nothing matches the inventiveness of human imagination. AI cannot design anything of higher intelligence than itself.


20 posted on 05/29/2017 10:47:48 PM PDT by TexasRepublic (Socialism is the gospel of envy and thse religion of thieves. Socialism is governmental theft!)
[ Post Reply | Private Reply | To 1 | View Replies]


Navigation: use the links below to view more comments.
first 1-2021-22 next last

Disclaimer: Opinions posted on Free Republic are those of the individual posters and do not necessarily represent the opinion of Free Republic or its management. All materials posted herein are protected by copyright law and the exemption for fair use of copyrighted works.

Free Republic
Browse · Search
Bloggers & Personal
Topics · Post Article

FreeRepublic, LLC, PO BOX 9771, FRESNO, CA 93794
FreeRepublic.com is powered by software copyright 2000-2008 John Robinson