Hacker Newsnew | past | comments | ask | show | jobs | submit | more throwawayjava's commentslogin

Two other important points:

1. Those command line programs weren't necessarily designed with an adversarial user in mind! Sanitizing input to prevent shell escape sequences is not enough. You really need to sandbox well.

2. For some tasks, it might be easy for a malicious user to guess which command-line tool you are using. You might be getting way less depth out of obscurity than you think you are.


That's one very important reason why you want that queue. That way you at least break the most obvious path to return output.


> We're aiming for all the advantages of static typing, coupled with all the advantages of dynamic typing. For example, you use the same types all the way from DB schemas to API validation.

Sounds like what Microsoft tried to do with the .NET ecosystem, but with cloud integration (which Microsoft should be doing for their own cloud) and API validation.

Someone needs to actually succeed at doing this. Most of the type-checking/inference problems in this domain are decidable -- it's really a tooling/tooling integration problem. Creating a single unified tool instead of having developers clobber together libraries (JSON schema validator, ORM, MVC framework, deployment workflow for all of that, etc.) would be a huge value-add.

Suggestion: code example/screenshot/workflow video on your homepage, and a link to your homepage in the advert. Nearly every programming language/library out there has a concise "hello, world" example on their homepage. Nearly every software development tool has a screenshot of sorts on their homepage. Those examples are worth a million words. Even an appropriately caveated "Wizard of Oz" (https://en.wikipedia.org/wiki/Wizard_of_Oz_experiment) demo would go a long way.


Thanks! If you have any things you think we should read, would love to see it.

Internally, we build a Real World app (https://github.com/gothinkster/realworld) and some other stuff. It taught us a lot but not nearly as much as a real developer will :)


> Your product is not backend-heavy, such as: ...machine-learning models

Maybe the meanings of these words have morphed over time, but in what sense is a "machine-learning model" not a back-end concern? It sure as heck isn't front-end...

(E.g., the current wiki page for "front and back end" explicitly mentions "converting the symbolic phonetic representation into actual sounds" as an example of a back end concern, and that's certainly the type of task that some people use machine learning for.)

Honest question: does "back-end" now mean "the CRUD and API client portions of a web-based CRUD app?"

This might go toward a larger question that others are asking: what exactly is darklang and what does it do?


Fair comment, thought something similar when I first read this, but ML falls into its own category IMO because it's not part of the "application" most of the time. It's back-end in that it's not front-end, but it's not what you'd normally consider the back-end of an app.

A model is built offline, experimented upon, tested, and then once ready "connected" to the main app. Like, the TensorFlow code you write doesn't "need" to be on the server; it could be running on your laptop for all you care. It's the output model that eventually makes it into the back-end ¯\_(ツ)_/¯.

> Honest question: does "back-end" now mean "the CRUD and API client portions of a web-based CRUD app?"

Back-end has always meant the CRUD/API portions of a CRUD app.


> It's the output model that eventually makes it into the back-end ¯\_(ツ)_/¯.

Yes, the model itself is part of the backend, not the code used to generate the model. But the website explicitly mentions "machine-learning __models__" as an example of something that's "not backend".

> Back-end has always meant the CRUD/API portions of a CRUD app.

This is not true. Compilers have backends. Speech processing pipelines have backends. The dragon book, which pre-dates the advent of the WWW, distinguished frontend from backend (and in those words).

Web-based CRUD apps inherited the terminology.


People have back-ends. Of course I know "back-end" is very broad, I just thought we were in the same page here, talking about a web back-ends, that is all.

Under that broad definition of the term, sure, go ahead and rant.


> Maybe the meanings of these words have morphed over time, but in what sense is a "machine-learning model" not a back-end concern? It sure as heck isn't front-end...

Huh? They're giving it as an example of something that is backend-heavy that they don't want your product to be like. You've got it backwards.

> (Your product is (not (backend-heavy, such as: ...machine-learning models)))


> They're giving it as an example of something that is backend-heavy that they don't want your product to be like. You've got it backwards

Yes, it's clear enough that they don't want you to be a member of that list. But what characterizes the elements of that list?! In any grammatical or intuitive reading of

"This probably isn't a good fit if your product is not backend-heavy, such as: ..."

the "..." is a list of things that are "not backend-heavy". And the first element is "iPhone game", which is certainly an example of something that is "not backend-heavy"!

> (Your product is (not (backend-heavy, such as: ...machine-learning models)))

Oh no! That's horribly confusing and not how lists are used in English! If that's what they meant, the post needs rewording. The correct way to say something like that is e.g., "Your product is back-end heavy but is not [insert delineating characteristics], such as: [insert original list here]".

To return the substance instead of grammar, IMO the "[insert delineating characteristics]" portion of that sentence is exactly what's missing from this advert!


> And the first element is "iPhone game", which is certainly an example of something that is "not backend-heavy"!

I thought they were referring to a multiplayer game with a server that has to be very low latency, handle a lot of connections, and not easily distributable, so that did seem backend-heavy.

But whatever they mean then, it's obviously not clear enough.


> They're giving it as an example of something that is backend-heavy that they don't want your product to be like.

I think it's you who have got it backwards.

Here's the entire thing:

"This probably isn’t a good fit if:

Your product is not backend-heavy, such as: an iPhone game, hardware, machine-learning models, blockchain, or embedded systems."

I read that as "if you're a hardware startup, you're not backend-heavy, so you are not a good fit", "if you're an iPhone game startup, you're not backend-heavy, so you are not a good fit", and yes, also "if you're a machine learning startup, you are not backend-heavy, so you are not a good fit".


I would have to agree with the person you are responding to.

The other examples (iphone games, embedded systems) are not back end heavy.

I think what they mean by "back end heavy" is actually CRUD heavy and they put all these systems together under that non-CRUD heavy banner.


> trying to build safety for something that doesn't exist and is highly likely to not truly exist for a loooong time.

Prioritizing safety results in a different vantage point on AI/ML/RL. Ensuring safety includes, as a sub-task, really understanding the mathematical foundations of new algorithms and techniques. In some sense, safety research is one way of motivating basic science on AI.

Managed well, a research program on safe AI is a "waste of resources" only in the same way that any basic science is a "waste of resources".


Safety has become a convoluted term for pseudo control over unintelligent and unpredictable Weak AI. The safety problem as it is framed in its current state centers on principal ideology for Weak AI and has, from what I can see, nothing to do w/ AGI nor are the approaches compatible. I seriously question what is the true motivation behind this over-stated agenda and have many answers as to why it exists and why it is so heavily funded/spotlighted.


> I seriously question what is the true motivation behind this over-stated agenda and have many answers as to why it exists and why it is so heavily funded/spotlighted.

First, you could say the same thing for all AI research at the moment! Grandiosity is perhaps even more common in subcommunities of AI that aren't safety focused.

Aside from grandiosity (either opportunistic or sincere), I don't think there's any sinister motivation.

More importantly, I don't think the safety push is misplaced. Even if the current round of progress on deep (reinforcement) learning stays sufficiently "weak", the safety question for resulting systems is still extremely important. Advanced driver assist/self-driving, advanced manufacturing automation, crime prediction for everything from law enforcement to auto insurance... these are all domains where 1) modern AI algorithms are likely to be deployed in the coming decade, and 2) where some notion of safety or value alignment is an extremely important functional requirement.

> ...and has, from what I can see, nothing to do w/ AGI nor are the approaches compatible

In terms of characterizing current AI safety research as AGI safety research? Well, there is a fundamental assumption that AGI will be born out of the current hot topics in AI research (ML and especially RL). IMO that's a bit over-optimistic. But I tend to be a pessimist.

> ...principal ideology...

As an aside, I'm not sure what this means.


Profit seeking. Career building. Fame and prominence aren't sinister. Instead they are common human motivation. Common enough to easily group a significant portion of the Grandiosity centered around 'AI'.

What easily breaks this down is the depth and breath of the research effort vs. that of the productization and commercialization effort. As for research, the only thing that is required is a computer, power, an internet connection. Again, this breaks down the vast majority of the grandiosity and carves out one's true motivations.

> More importantly, I don't think the safety push is misplaced. Here's how I saw it some years ago... You can beat your head against the wall and create frankenstein amalgamations of ever evolving puzzle pieces that you will require expensive and highly skilled labor to make sense of with an end product being an overhyped optimization algo with programatic policy/steering/safety mechanisms.. Or you can clearly recognize and admit the possible foundation of it is flawed and start from scratch and work towards What is Intelligence and how to craft it into a computational system the right way. The former gets you millions if not billions of dollars, a career, recognition and a cushy job in the near term but will slowly lock you out from the fundamental stuff in the long term. The later pursuit could possibly result in nothing but if uncovered could change the world including nullifying the need of tons of highly paid labor to do development for it. Everyone in the industry wants to convince their investors the prior approach can iterate to the later but they know in their heats it can't (Shhh! don't tell anyone). So, the question for an individual is how aware and honest are they with themselves and what is their true motivation. You can put on a show and fool lots of people but you ultimately know what games you're playing and what shortfalls will result.

> Well, there is a fundamental assumption that AGI will be born out of the current hot topics in AI research (ML and especially RL). Quite convenient for those cashing in on the low hanging fruit who would like investors to extend their present success into far off horizons.

> As an aside, I'm not sure what this means. It means the thinking that weak AI is centered on could cause one to be locked out from perceiving that of AGI. It means : https://www.axios.com/artificial-intelligence-pioneer-says-w... But everyone is convinced they don't have to and can extend/pretend their way into AGI.


I don't think the tenor of your post is very fair.

> Again, this breaks down the vast majority of the grandiosity and carves out one's true motivations... Everyone in the industry wants to convince their investors the prior approach can iterate to the later but they know in their heats it can't (Shhh! don't tell anyone). So, the question for an individual is how aware and honest are they with themselves and what is their true motivation. You can put on a show and fool lots of people but you ultimately know what games you're playing and what shortfalls will result.

The rest of my post is a response to this sentiment.

> As for research, the only thing that is required is a computer, power, an internet connection.

All that's necessary for world-shattering mathematics research is a pen and paper. But still, most of the best mathematicians work hard to surround themselves by other brilliant people. Which, in practice, means taking "cushy" positions in the labs/universities/companies where brilliant people tend to congregate.

Maybe most great mathematicians don't purely maximize for income. But then, I doubt OpenAI is paying as well as the hedge funds that would love to slurp up this talent! So people working on safe AI at places like OpenAI cannot be fairly criticized. They're comfortable but clearly value working on interesting problems and are motivated by something other than (or in addition to) pure greed/comfort.

> Profit seeking. Career building. Fame and prominence aren't sinister. Instead they are common human motivation. Common enough to easily group a significant portion of the Grandiosity centered around 'AI'.

So what? None of these motivations necessarily preclude doing good science. Some of those are even strong motivators for great science! The history of science contains a diverse pantheon of personality types. Not every great scientist/mathematician was a lone genius pure in heart. In fact, most were far more pedestrian personalities.

The "pious monk of science" mythology is actively harmful toward young scientists for two reasons.

First, the ethos tends to drive students away from practical problems. Sometimes that's ok, but it's just as often harmful (from a purely scientific perspective).

Second, this mythology has significant personal cost. More young scientists must realize that it is possible to make significant contributions toward human knowledge while making good money, building a strong reputation, and having a healthy personal life. Maybe then we'd have more people doing science for a lifetime instead of flaming out after 5-10 years.

> It means the thinking that weak AI is centered on could cause one to be locked out from perceiving that of AGI.

Thanks for the clarification!


I think what I have stated is quite fair and established at this point in documented human history... There's no reason to play games and shy away from the truth and reality anymore. This continued games we play with each other via masking our true selves and intentions is what leads to the bulk of suffering and what people claim 'we didn't see coming'. The vast potential of the information age has devolved into a game of disinformation, manipulation, and exploitation and the underpinnings of such were clear to anyone being honest with themselves as it began to set in. The facebook revelations were stated years in advance before we reached this juncture. Academics/Psychologist conducted research/published reports on observations any honest person could make about what the platforms functioned on and what it was doing to society.

> All that is required is pen/paper/computer/internet connection Then why do we play the game of unfounded popularity? Why isn't there are more equal spotlight? Why do the most uninformed on a topic acclaim the most prominent voice? In these groupings you mention are hidden and implied establishments of power/capability. A grouping if PhDs, regardless of their works is considered to be of more valuable than an individual w/ no such ranking but whom has established far more (as shown by history). The forgotten heroes, contributors, etc is a common observation of history. It's not that they're 'forgotten', it's that social psyche choses not to spotlight or highlight them because they dont fit certain molds. An established/name personality asks for funding and gets it regardless of whether or not they have a cohesive plan for achieving something. Convince enough people of a doomsday destructive scenario and you'll get more funding than someone who is trying to honestly create something. Of course, you can then edit mission statements post-funding. What of the lost potential opportunity? What of the current state of academia? > https://www.nature.com/news/young-talented-and-fed-up-scient... > https://www.nature.com/news/let-researchers-try-new-paths-1.... > https://www.nature.com/news/fewer-numbers-better-science-1.2... The articles do get published long after a trend has been operating.. Nothing changes. It takes then someone who truly wants to implement change for the better w/ no other influence or goal in mind to fundamentally change something. This happens time and time again throughout history but institutions and power structures marginalize such occurrences to rebuff and necessitate their standing.

You don't need people in the same physical location in 2018 to conduct collaborative work yet the physical institution model still remains ingrained in people's heads. Money could go further, reach more developers, and provide for more discovery if it was spread out more and centralized in lower cost areas yet the elite circles continue to congregate in the valley.

The Ethos of Type A extroverts being the movers/shakers of the world has been proven to be a lie in recent times. So, what results in fundamental change/discovery isn't a collective of well known individuals in grand institutions. It is indeed the introvert at a lessor known university who publishes a world changing idea and paper who only then becomes a blurred footnote in a more prominent institution and individual's paper. The world does function on populism and fanfare.

> Second, this mythology has significant personal cost. It indeed does. It causes the true innovators and discovers a world of pain and suffering throughout their life as they are crushed underneath the weight of bureaucratic and procedural lies the broader world tells itself to preserve antiquated structures.

> More young scientists must realize that it is possible to make significant contributions toward human knowledge while making good money, building a strong reputation, and having a healthy personal life. Maybe then we'd have more people doing science for a lifetime instead of flaming out after 5-10 years.

More Young scientist must be given the chance to pursue REAL research and be empowered to do so. They must be empowered to think different. They must be emboldened to leap frog their predecessors and encouraged to do so w/o becoming some head honcho's footnote. Their contributions must be recognized. They must be funded at a high level w/o bureaucratic nonsense an favoritism. A PhD should not undergo an impoverished hell of subservience to an institution resulting in them subjecting others to nonsensical white papers and over complexities. A lot of things should change that haven't even as prominent publications and figures have themselves admitted : https://www.nature.com/collections/bfgpmvrtjy/

I've walked the halls of academia and industry.. I've seen the threads and publications in which everyone complains about the elusive problems but no one has the will or the desire to be honest about their root causes or commit to the personal sacrifices it will take to see through solutions.

I'll probably have the most negative score on Ycombinator by the end of my commentary in this thread yet will be saying the most truthful things... This is the inverted state of things.

So, Mankind has had a long time to break the loops they seem stuck in. Now is the time for a fundamental leap and jump to that next thing beyond the localized foolishness, lies, disinformation, and games we play with each other.


What, concretely, makes you think that any of those companies wouldn't place a focus on safety and value alignment? Automobile manufacturers and their tier 1 suppliers are the world leaders in automobile safety, after all.


> What, concretely, makes you think that any of those companies wouldn't place a focus on safety and value alignment?

Competitive pressure, and the "if we don't, someone else will" effect (or Moloch, if you like). AGI- particularly recursively self-improving AGI- is the ultimate first-mover advantage: the first company or country to have AGI will very likely be able to leverage that into keeping anyone else from getting it (if it doesn't, y'know, kill us). This strongly encourages treating all concerns other than "get there first" as secondary.

> Automobile manufacturers and their tier 1 suppliers are the world leaders in automobile safety, after all.

Not by choice they aren't. They are forced to be the way they are by government regulations, which they always bitterly opposed at the time of creation. In fact, capitalism has such a reliable record of "not giving a shit about safety until they are forced to" that I'm perplexed you think AGI would be any different.


I think there will be at least a minimum of focus on safety and value alignment.

They may have to focus on safety and aligning it to the companies values (else test/weak versions are likely to destroy/negatively impact the company or at least be useless). Which is at least something.

Only hyperrational/intelligent value unaligned intelligent systems would avoid this pressure. I don't see the development going that way.

It would still be sub optimal though.


This is a great response. Thanks.

> Not by choice they aren't.

This is why I was glad to see this in TFA:

>>> ...while increasing the importance of sharing safety, policy, and standards research."

Even for Weak AI, history tells us that these factors -- policy and industry collaboration -- tend to be significant ingredients in successful safety reforms.


> recursively self-improving AGI- is the ultimate first-mover advantage: the first company or country to have AGI will very likely be able to leverage that into keeping anyone else from getting it

How? This doesn't seem axiomatic.


Seems clear that you could instruct the AGI to do anything it could to interfere with other organizations efforts to build an AGI. Obviously Nation States would have strong reasons for pursuing such a course of action and unscrupulous corporations would likewise have strong capitalistic motivations to do so.


Seems very unclear if you could "instruct" true AGI to do something.


Maybe you assume that an AGI would be totally uncontrollable but in this highly speculative exercise I don't think you should assume your position is the only valid one.


First you said it's clear, now you're saying it's highly speculative. Choose one.


I see no conflict.


I don't think you should assume your position is the only valid one.

I don't, that's why I said "very unclear" (to me). If something is "clear" to you about AGI, then it seems like it's you who makes that assumption.


Seems very unclear if you could "instruct" true AGI to do something.

So you are claiming that by making this statement you are not assuming that it is impossible to control an AGI?


I'm claiming that it's not clear to me whether we can control it or not.

This is similar to having a very advanced bioengineering technology, where you could instantly change anything about your body. Would you make yourself smarter? Sure. Would you change who you are (e.g. turned off your instincts/desires)? Not so sure.


Attempting safety and achieving safety are not the same thing. The default way new things get invented involves iterative attempts that gradually reduce failure cases. The fear is that AGI failure modes might be catastrophic and non-recoverable.


They're also the world leaders in automobile safety-defects.


This is what always amazed me about the AI safety groups... and mission statements for funding therein : There is nothing to suggest the minds and efforts capable of producing AGI will not have solved this at a fundamental level. Absolutely nothing... and after-all something of high intelligence is within controlled and reasoned states. If someone declared they created AGI and it was behind a door and when that door was opened you saw a robot manically trashing the place, you'd clearly laugh.


haven't read a ton into it, but whatever Google is doing with the Pentagon probably runs counter to what OpenAI claims to be after.


Not necessarily. Project Maven probably has no intention of developing AGI and therefore probably is not a concern to value alignment problem.


> as if that’s a good thing.

Developing a network of peers IS a good thing!

> Isn’t it intensely anti-meritocratic

I guess that depends on how yo define "merit".

The ability to build professional networks is actually a valuable skill, not just for the individual but also for the business. And the network itself is valuable.

I can think of three of reasons why a business would, on merit alone, prefer someone with demonstrated ability to build their professional network, or who is plugged into a particular professional network:

1. When it comes to hiring, "merit" does not mean "the best person"! "Merit" means "someone who can do the job and who we can convince to take the job given recruiting budget X and max comp package Y." If locating a candidate among the chafe costs more than "X", then that candidate ISN'T a meritorious candidate. No matter who good they would be at the job!

2. Businesses often recruit to access to an entire network/pipeline, not just a single engineer. This is a common pattern at lower-paying shops especially. Recruiting your Nth engineer from State U is easy because you already have recruit N-1 to give you the names of five people who would probably do well. Now, in any given year, the business could recruit zero people from State U. But then they have to rebuild their State U pipeline in subsequent years.

In other words, your network is part of the value you provide to the company! Someone with no professional network is strictly less valuable than someone with a professional network. And in some regional job markets, "Alumni of State U" is a valuable recruiting network.

3. Someone with a strong professional network has signaled that they have a modicum of skill at "winning hearts and minds". Depending on the shop, engineers who are good at building and maintaining reputation over the long term bring way more value than just the LoCs they commit during their period of employment.

4. It's also worth pointing out that someone you recruit via one of these networks might have a niche combination of skills that would be otherwise hard to discover. E.g., "oh, we're hiring a new dev to work with a new client in industry XYZ. I have an old friend who double majored in CS and ABC, which gives him the background needed to talk with folks in industry XYZ. Should I give him a call?". Again, the definition of "merit" is "we can find you with budget X and you're willing to do the work for comp package Y". NOT "you're the ideal candidate if we had X+Z recruiting budget to cast a wide net and find you"

All that said, hiring college buddies can be anti-meritocratic, for sure. Life isn't fair. Just one of the reasons colleges require freshman read Shakespeare :)


> What, aside from the obvious associates degree at completion and an accelerated pathway to a bachelors degree from a 4-year program, does community college provide that MOOC micro-programs do not?

CCs offer 2 tracks.

Track 1: college prep. Students take a year or two of courses and then transfer to a 4 year institution.

For this track, the "trustworthy signal of competence" is by far the most important aspect of the product. So for CCs offering this track, your question is a bit ill-formed. You're basically asking "aside from the most important thing, what else is important?"

Track 2: Terminal associates degrees for students who will enter a trade immediately out of CC.

For this track, at least sometimes, MOOCs don't work as well because you need hands-on experience. Often, you also need connections to local institutions (for setting up volunteer hours and for job placement). IMO MOOCs shouldn't even try to focus on this track, at least for certain trades like nursing.

> Are the value gaps narrowing?

For track 2, it depends on the trade, but mostly no.

For track 1, MOOCs need to figure out the assessment problem and provide compelling evidence to higher ed that completing a MOOC is a strong signal of future success.

Finally, it's worth pointing out that MOOCs work well for some types of students (I wish they had been an option for me), but do not work at all for other types of students.


> Maybe you're opposed to using government aid which is fine

It's also worth pointing out that Pell Grants for CC tuition often constitute less public money than you were consuming during K-12.


> Just teach more advanced subjects in both High School

Many affluent high schools have an abundance of AP/IB courses. Many high schools also have additional college-credit courses (where the high school acts as a sort of proxy for a local college, often a community college). At a "good" high school, students can combine all of these options to have not just a year, but even junior or senior standing by the time they start college.

There are three problems with this approach:

1. Not all high schools are affluent / have their crap together enough to offer these options.

2. students need to be prepared. Enough of them that you can fill a course. This can be a barrier in less affluent areas.

3. Students have to know about this option, usually starting in middle school so that they can begin working ahead early (e.g., finish algebra in middle school).

> ...and college

The pattern here seems to be picking the college vs. picking the more advanced courses at the college. So, you don't take "more advanced couses at regional State campus"; instead, you go to (your field's equivalent of) MIT/Stanford/Berkeley/CMU. Or at least the state flagship. C.f., algorithms at an elite university vs. algorithms at the branch campus of a middling state system. The differences in both depth (rigor) and bredth are, in many cases, quite extraordinary.

> No child left behind and other programs hinder education by applying one size fits all policies.

Do you have any data to justify this assertion? AP offerings have increased since NCLB was enacted.

I don't disagree with you that NCLB is a net harm, but I don't think it's accurate to place the blame there for this particular problem. (Also, whenever NCLB comes up, it's worth pointing out that states bear a lot of responsibility -- they have quite a bit of leeway in how NCLB is implemented.)


> Secondly an ISP charges you a subscription and that is their revenue model. They are not incentivised to build an elaborate profile on your in order to deliver advertisement.

That's exactly the opposite of how corporations work. Especially corporations in monopoly/duopoly markets.

In fact, US ISPs lobbied heavily for the right to do exactly that, without user permission, and got their way.

> Thirdly ISPs in most countries are required by law to support the police with surveillance information. That is done in transparent way (you can read the laws and ask your politicians).

But that's not what this is about.


Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: