I'm a Bryan Cantrill fan so I'm glad this is working out, I was extremely skeptical of them at the beginning(on HN too), I think because I've built DCs for many years and was stuck in a mindset that served my use case, I've come around to Oxide. My main concerns originally were 2 fold: "this seems bougie", is there actually a market for this, and, is there a good interoperability story with mix and match. From what I could tell the answers were "yes" and "don't care" - I had thought this wasn't a great answer but it seems I'm wrong. I was chatting with Boris Mann just last week about them and he said "actually John that isn't correct, think of how much quick compute needs to come online and how much discreet compute is going to be required with low management overhead, they're doing just fine and that market will grow" - After that I did some research and pondered on it for a day - I think my friend is right and I am wrong, I think at this point Oxide is going to be a really strong name and I wish them the best of luck.
unicornhose · 21m ago
I must admit that I am much more unsophisticated than this, and yet I "invested" in Oxide (by running my own projects off Oxide servers), and it is gratifying to see them continue to grow. My (naive) assessment: (a) agreed with Cantrill's opinions on software, (b) liked his willingness to put himself out there, and (c) felt the eng blogs showed a high level of (socio-)technical ability.
I think for the internet to break out of walled gardens, high-quality independent datacenters need to exist -- nobody wants to manage their own datacenters, and nobody wants to rely on Google/Amazon/Microsoft's platforms or (even worse) business products. I hope this continues.
sethops1 · 4h ago
I was skeptical as well, if only because just being a better product isn't enough to win the market. Everything we hear about Oxide sounds like an impressive green field implementation of a data center, but is that enough? Do the people making buying decisions at this scale care if their sysadmins have better tools?
9dev · 4h ago
If it translates to improved efficiency, sure. And this big of a round seems to indicate that idea has some merit
transpute · 4h ago
What percentage of enterprise IT compute has not moved to a public cloud?
I know I have been involved in multiple efforts to move the same workloads into and then out of the cloud, as corporate budgeting requirements prioritized either capex or opex at different times.
dmoy · 3h ago
I'm not sure anyone really knows
uptime institute publishes some good numbers from survey, which puts on prem + colo still at >50% last I checked.
And still some additional 5% in like... on prem in closets.
Last year Amazon said it was 85% on prem. I dunno who has the right numbers.
zer00eyz · 4h ago
> Do the people making buying decisions at this scale care if their sysadmins have better tools?
Look at who oxide is selling to and for what reasons.
It's about compute + software at rack scales. It does not matter if it is good it matters that it's integrated. Gear at this level is getting sold with a service contract and "good" means you dont have to field as many calls (keeping the margins up).
> Everything we hear about Oxide sounds like an impressive green field implementation of a data center, but is that enough?
Look at their CPU density and do the math on power. It's fairly low density. Look at the interconnects (100gb per system). Also fairly conservative. It's the perfect product to replace hardware that is aging out, as you wont have to re-plumb for more power/bandwidth, and you still get a massive upgrade.
keeda · 2h ago
As someone only tangentially familiar with this domain, I have questions about this:
> Look at their CPU density and do the math on power. It's fairly low density. Look at the interconnects (100gb per system). Also fairly conservative. It's the perfect product to replace hardware that is aging out, as you wont have to re-plumb for more power/bandwidth, and you still get a massive upgrade.
It sounds like the CPU density and network bandwidth are not great. If it's only suitable to replace aging systems, does that not limit their TAM? Or is that going to be their beachhead for grabbing further market share.
steveklabnik · 2h ago
I am not saying that I fully endorse the characterization of the parent, but it is true that we started selling these systems two years ago, and new hardware comes out with better stats all the time.
Given how small we are, new designs and refreshes take a while. Part of growing as a company is being able to do this more often. We'll get there :)
throwpup666 · 4h ago
I still dont get it. If someone else's software is running the hardware, what difference does it make if its on-prem or offsite?
steveklabnik · 4h ago
> If someone else's software is running the hardware
Our stack is open source.
> what difference does it make if its on-prem or offsite?
The difference is not where it runs, it's that you own our racks, rather than rent them. In the traditional cloud, you're renting. Other vendors who sell you hardware will still have you paying software licensing fees, so it never feels like you truly own it. We don't have any licensing fees.
doctorpangloss · 5m ago
First let me say I really like this part of your guys narrative: you have really strong opinions about how infrastructure and IT should work at many levels, like technically and aesthetically, that seems real and nice and likable.
Focusing on just this financial narrative you're weaving, what stops a bank from selling "virtual racks" that work financially the same as owning an Oxide rack, but it's just AWS?
$1m buys you 42U of, whatever. You're handed an AWS account you do not pay for, but it has the $1m worth of, whatever in it, in perpetuity. Maybe the bank even throws in some fakey market you can "part out" and "sell" your rack to, years later, at some "market price."
It seems like, the product - and maybe the experience of buying the product - is what is most important to Oxide. It's really interesting to me, because I cannot wrap my head around what this narrative is:
You guys are Apple of Racks. But minus the iPhone, because there is no monopoly here. So, Apple (Minus iPhone) of Racks. Is that it? It's the rest of their offerings, which without the iPhone monopoly effects, are Buying Experiences. It's like when people buy $10,000 Mac Studios to "run LLMs", which of course they are going to do like, zero to one times, because they are excited about the idea of the product. For the audience that needs to "run LLMs" they buy, whatever, or rent. But they don't buy Mac Studios. Just because people do something doesn't mean it makes sense.
Is the narrative, AWS Doesn't Make Sense? Okay, you can't go and say, because people do things, it makes sense, because: AWS makes a ton of sense, for basically everyone. Everybody uses it and pays up the wazoo for it. And there are good objective reasons AWS makes sense, at basically all levels. Who is fooled by, "AWS doesn't make sense?"
The problem with AWS isn't even that they are expensive. It's that Amazon is greedy. It could be cheaper, which is a different thing than being expensive. It matters because "AWS stays greedy longer than the average Y Combinator company stays private" is an interesting bet for an investor to take. They could decide to be less greedy at any time, and indeed, it did not take long after offerings of S3-like storage from others led them to simply reduce prices.
What that is telling me is, I could take $100m in funding, sell $1m "racks" of equivalent compute on the Rolls Royce of cloud infrastructure, making everything financially and legally and imaginarily the same as ownership, and then take a $300k loss, right? On each "rack", same as your loss? It's a money losing business, but here I am making the money losing very pure, very arby. Is this what you are saying customers want?
Clearly they want a physical rack. By all means, I can send them a big steel box that provides them that aesthetic experience. Cloudflare, Google, they do the physical version of this all the time: dumb, empty appliances that are totally redundant, because people ask for them. RudderStack, Weights & Biases, a bunch of companies come to mind doing the same thing in software, like so called Kubernetes Operators that literally just provision API keys but pretend to be running on your infrastructure. People ask for Kubernetes operators, they made them, but of course, they don't do anything. They are imaginarily Kubernetes operators.
The reason there are licensing fees and rentals and whatever is the enterprise sales pipeline, right? Enterprise sales is, give people want they ask for. People ask for a price that's below $X up front, so that's what IT vendors do, and then it turns out people are okay with some ongoing licensing fees, so there. That's what they do.
Are there any storage-related roles? Will Oxide redefine storage as well?
steveklabnik · 42m ago
We don’t have any storage specific positions to my knowledge, but that falls under the control plane job, they’re the ones working on Crucible.
stavros · 2h ago
Thanks! Not much for my skillset, but I'll keep an eye out!
archon810 · 1h ago
I just have to say this is an incredible page. Everything is well thought out and there's no BS. The salary is upfront too and everything is remote. A gold standard for hiring pages?
transpute · 4h ago
Is the software open-source with reproducible builds of any runtime binaries?
Oxide has been remarkably transparent about the development and architecture of critical system components. We can only hope they succeed and inspire others to follow their transparency lead.
gtirloni · 3h ago
Open source is a requirement but not the only one. There are countless examples of companies building integrated solutions based off of open source projects that, when they went bankrupt, there was nobody to pick up the available pieces and continue moving the stack forward. Just pointing out that open source is not this magical escape hatch that some people think (at least not in corporate environments).
yencabulator · 3h ago
Especially so for Oxide's decidedly non-Linux setup. They are in a niche software ecosystem with practically no one else. Apparently mostly because they're practically all ex-Solaris staff.
(Listing all projects using ZFS or DTrace as "who uses Illumos" is cheating.)
ryao · 1h ago
I remember many Linux fans saying that monocultures were bad until Linux became so popular that Linux was the one benefiting from a monoculture. Despite that, the rationale against monocultures still applies.
That said, Illumos is influential as an organ donor to many others. There are a number of awesome technologies in it.
yencabulator · 1h ago
Oh I would love to have some healthy competition to Linux, but I am not rooting for Solaris to do that, I'd rather have one of the Rust-based microkernel actually git gud. Time to shake the foundations of the age-old security and isolation models, not resuscitate a dusty old thing built on piles of C and shell on top of a large monolithic kernel and pretend everything's fine.
> Apparently mostly because they're practically all ex-Solaris staff.
I absolutely do not have a Solaris/illumos background! The first time I ever sshed into an illumos machine was my first day on the job.
jiveturkey · 1h ago
The exception proves the rule. You can't deny the deep Solaris heritage.
sunshowers · 22m ago
I wouldn't deny that, no.
bpt3 · 2h ago
Cloud computing is significantly more expensive than self-hosting for most large organizations. People are slowly figuring that out, and Oxide was a bet on the timing of that realization.
No comments yet
0xbadcafebee · 2h ago
Even if it makes no sense as a technical thing, businesses will buy it. Look at all the huge companies that keep spending millions trying to DIY their own datacenter for the 3rd time. Enterprise loves to buy big iron and self-hosting crap, so I'm sure they will be successful selling this. However, I think they're going to need to branch out to more services in order to continue increasing their revenue every year (after 5+ years lets say).
mike_d · 1h ago
> Look at all the huge companies that keep spending millions trying to DIY their own datacenter for the 3rd time
You mean all the huge companies that ran multiple datacenters before the cloud was even a thing?
Does everyone at Oxide have the same equity grant?
Aurornis · 7h ago
> Does everyone at Oxide have the same equity grant?
I thought I saw this question answered in a previous thread and the answer was basically “no”, but the question has been avoided a lot.
Aspects of equity compensation would inherently need to be different over time due to valuation, fundraising stage, and so on. However I always thought it was strange that they made a big deal about paying everyone the same base salary but then were silent on the equity comp strategy. Everyone knows that in a job like this the total comp is important.
The old Oxide compensation discussions were interesting. There was discussion about how they thought candidates asking about compensation to be something of a negative signal because they wanted people who weren’t in it for the money, basically. I heard this from a now ex-employee of Oxide who was describing how to navigate their hiring process, so take with a grain of salt.
> Some will say that we should be talking about equity, not cash compensation. While it’s true that startup equity is important, it’s also true that startup equity doesn’t pay the orthodontist’s bill or get the basement repainted. We believe that every employee should have equity to give them a stake in the company’s future (and that an outsized return for investors should also be an outsized return for employees), but we also believe that the presence of equity can’t be used as an excuse for unsustainably low cash compensation. As for how equity is determined, it really deserves its own in-depth treatment, but in short, equity compensates for risk – and in a startup, risk reduces over time: the first employee takes much more risk than the hundredth.
Which doesn't answer the question.
mystraline · 6h ago
> There was discussion about how they thought candidates asking about compensation to be something of a negative signal because they wanted people who weren’t in it for the money, basically.
I've heard this from multiple hiring managers and C levels. The cognitive dissonance is amazing.
Do you know why I show up and work? Because I am paid for it, and in this country, medical is also gatekept by employment.
If I wasn't paid, I wouldn't work for them.
But somehow, I'm supposed to not care about money at the same time caring about money.
rtpg · 4h ago
Back when my salary was shitty I cared about the money a lot.
I still like the money and the number going up. But now that it’s above a certain multiple of what I consider a “comfortable” life, I’m not worrying as much.
Would for change your job for an extra 500k a year? Surely right? An extra 50k? An extra 5k? An extra 500 dollars a year?
Theres some mental calculus that includes everything. Some people will just take “offer with most money” every time. Hell of a lot of people don’t.
I do think that C suite folks might not have the right vision of what “normal/comfortable” is for employees though. So they might offer a low number thinking it’s actually a “comfortable to live with at this stage of life” number and then get confused why they can’t recruit good talent and think people are obsessed with money.
First offer has gotta be within the ballpark of the right number if you don’t want your interviewee to immediately come back to you with a much higher number!
bobsomers · 26m ago
> I still like the money and the number going up. But now that it’s above a certain multiple of what I consider a “comfortable” life, I’m not worrying as much.
I agree, but that number for most people is not the $207k/yr Oxide is paying.
For most people that number is likely north of $500k, if not single digit millions.
mbreese · 2m ago
That heavily depends on where you live and your life situation (young kids? older kids? No kids?).
dpritchett · 6h ago
It’s a bit of a class thing, isn’t it?
Independently wealthy folks can stay in the game longer without needing to extract a lot of cash compensation in the company’s early years.
steveklabnik · 6h ago
This is true in the abstract, but we're talking about a salary of $207,264 in this case. You don't need to be independently wealthy to make it on our salary.
benreesman · 5h ago
It's still a class thing. With the CoL in most SWE-heavy metros and the outright war on engineer pricing power over the last few years?
Just about any engineer who isnt independently wealthy is:
- recovering from layoffs and a period of unemployment at a high-COL cost structure
- facing layoffs with the above salients
- facing an imperative to insulate their fucking house with cash for their turn in the above crosshairs
Competence and a willingness to work hard stopped equalling access to basic necessities in November of 2022 - February of 2023, depending on how you count, and inflation has savaged a notional 200k.
"200k is plenty to live on" is rich, well-connected guy talk in 2025.
Aurornis · 5h ago
> With the CoL in most SWE-heavy metros
They’re a remote company. They’re not targeting HCOL metros.
> and inflation has savaged a notional 200k.
> "200k is plenty to live on" is rich, well-connected guy talk in 2025.
Claiming that $200k is not enough to live on is rich-guy talk. The majority of the country lives on well below $200K.
I agree that a single person living in a HCOL metro like SF Bay Area would not find this compensation attractive, but that person also has nearly infinite other jobs to choose from nearby.
Jobs like this (remote work for interesting startup) do not need to pay HCOL comp.
benreesman · 5h ago
Nothing about a remote gig in one job affects the imperstives I highlighted about past layoffs or future uncertainty: pricing relocation into or out of e.g. SFBA at zero is another conversational gambit popular with the out-of-touch. You don't teleport.
It's bad generally, this is a terrible time to be a working person in general. How SWEs stack up against profession X? Depends on profession X.
SWEs are in a job market where a bunch of folks who have been repeatedly prosecuted for wage fixing (most successfully/recently in 2012) are taking another swing at it in a much more lawless regime. That's as precarious as it gets when this cabal monopolizes the front row at the Inaugeration.
Aurornis · 5h ago
> pricing relocation into or out of e.g. SFBA at zero is another conversational gambit popular with the out-of-touch. You don't teleport.
I think this is missing the point.
The target audience for remote jobs that pay $200K does not overlap with the target audience of people interested in working in SFBA at FAANG-level compensation.
If someone is interested in relocating to SFBA, they should do that and get a job there.
rtpg · 4h ago
200k a year. In US dollars. American dollars.
Now you have families, debt, etc. There are things. Minimum expectations for family etc. But come on! It’s not poverty wages!
“I am willing to take a pay cut for a thing that I’m passionate about” is such a normal thing that everyone serious I know in this industry says. Or like… even just ethical choices to leave money on the table (there’s a reason online casinos pay their software engineers so much!). Not everyone makes the choice (and I get people saying no) and but in a sense I gotta imagine it’s part of the calculus for making it work. “We won’t have to pay people half a mil in total comp like meta has to, because the mission is more straightforward”. I feel like an O&F ep mentioning someone from intel expecting _triple_ the comp. 600k!
And like… people saying it’s not enough and talking about equity. You’re not paying rent with equity!
Signed: a guy who was at a small startup and who would have been very happy with the inflation/CoL equivalent of 200k instead of what I had those early leaner years
At one point “joining the scrappy startup” does involve some scrappiness. Otherwise you’re just working in a division of Google that hasn’t been integrated into the borg yet.
nemothekid · 3h ago
Focusing on the raw dollar amount is a red-herring that always comes up in these conversations. 200k is plenty! is a sleight of hand. If I am building something with 10s of millions of value and you give me 200k and expect me to shut up cause it's plenty, you are deceiving me, full stop.
The "we all get paid the same" is a dishonest by omission. They don't all get paid the same, and while the peanut gallery may think so, I sure as hell don't think the IRS thinks the same way.
I personally don't really care what they pay their engineers, but to pretend to have this egalitarian approach to compensation and then hide the equity numbers is dishonest.
No comments yet
steveklabnik · 5h ago
> "200k is plenty to live on" is rich, well-connected guy talk in 2025.
The median US income in 2023 was $39,982 for an individual, and $78,538 for a household.
benreesman · 5h ago
My issue isn't with Oxide's comp steucture which I neither understand nor care about.
My issue is with made-for-life, self-appointed elder statesmen on HN saying anything at all about other people's finances and imperatives from the comfort of a study in whatever isyllic community they're pontificating from.
Just, be grateful, and say nothing.
steveklabnik · 5h ago
> My issue isn't with Oxide's comp steucture which I neither understand nor care about.
This is a sub-thread about it, so that's what we're talking about though.
> Just, be grateful, and say nothing.
That's not how message boards work. If you say that it's ridiculous to live on such a salary, I'm going to point out how out of touch that is.
benreesman · 5h ago
That's not what I said, you know that's not what I said. I said people who talk like that on HN are doing so from an unrelated personal experience.
This sub-thread is about the habits of speech that make a certain breed of armchair public policy economist jump out like a lump on plate glass. Get Patek in here and we could start a convention.
steveklabnik · 5h ago
> you know that's not what I said.
Okay, just so you know, I did not understand that you were speaking in generalities whatsoever.
benreesman · 5h ago
Fair enough, this is a topic with a high and asymmetrical charge quotient and misunderstandings are a fact of life in such.
I also regret any degree to which I've singled you out for a generally regrettable trend among the long-time community members: it's very easy to see the world through the lens of one's own experience and I've been as guilty as anyone of doing just that on plenty of occasions.
We should all strive for empathy and understanding, that goes double for people like you and me (and Thomas) who have been around forever.
epicureanideal · 5h ago
I completely agree.
Note that according to https://www.usinflationcalculator.com/ 200k in 2025 is equivalent to about 160k in 2020 when the pandemic began, and 160k would've been on the low end for an experienced software engineer at a Series A or B startup at that time, in the SF Bay Area.
Aurornis · 6h ago
Exactly. It’s also important to know that they support remote work, so these salaries really are not bad at all. For someone in a non-tech city who doesn’t want to move this would be a great startup job.
My only reservation is that I’ve interviewed with or worked for multiple companies that made some claim about paying everyone the same and there was always some loophole: The company might have a fixed base pay but then use very different equity grants. One company claimed to give everyone the same base comp and equity but then it was discovered that some people were getting huge annual “guaranteed bonuses” that were effectively base compensation. It has left me tired of seeing companies push the idea of everyone being paid the same while not being open about the entire compensation structure.
EDIT: To be 100% clear, I don’t know what Oxide’s entire comp structure looks like. The examples above were for past companies I worked for.
steveklabnik · 5h ago
We have salary and equity, no bonuses. Salary is identical, equity is not. I certainly agree with you that that kind of shenanigans can be annoying; I had a former employer who hired people with "oh it's a bonus but you always get 100% of it" and then, we did not get 100% of it.
Aurornis · 5h ago
> Salary is identical, equity is not.
Thank you. This is the question I was hoping to see an answer for.
brettgriffin · 2h ago
More important than just getting answer, do you understand _why_ every employee isn't granted the same amount equity?
Aurornis · 5m ago
Isn’t it obvious? This is where they vary compensation for the same reasons everyone else varies compensation.
If they gave everyone the same equity compensation presumably they’d put that front and center like they do for the base salary.
The claims about paying everyone the same are a red herring because it’s only about base salary.
tialaramex · 4h ago
Bonuses are bullshit. When the first startup I worked for was acquired they asked everybody to basically agree they won't quit for a period of time - transition. Fair enough. However for the ordinary staff (like me) this agreement had no actual carrot, they're offering a so-called "Bonus scheme", but it's clearly designed so that they decide what it pays, whereas execs are getting an up-front specific financial inducement to stay. So I explain to colleagues that if you might want to quit you should not sign, the "bonus" is worthless but you're locked in by signing - however I did get some pushback from people who could not see this or haven't done this before.
Sure enough when that bonus was due to pay out, I got a heads up from a friend (who was being compensated because he was like CTO or something) that it was worthless, because of course they get to pick the numbers so they're going to pick zero. I don't care, because I was on a different scheme and anyway I work for salary, if you want to pay me to do something, you can pay me, don't fuck about with nonsense about a "bonus", but some people ended up stuck for a year or two believing they're getting a bonus to wait.
throwanem · 5h ago
It's bullshit to talk about salary equality as though that mattered when equity is the real upside, and you know it. The claim to strive for a "generational company" is just "we're a family here" in other terms. Congrats on the raise.
steveklabnik · 5h ago
I think there are tremendous benefits to having a flat salary structure, regardless of upside. My other friends in tech are envious of the lack of having to waste time doing perf, for example.
> Congrats on the raise.
Thank you.
throwanem · 5h ago
From your perspective of course it has benefits. From mine? Getting stack ranked wasn't even in my top 10 as concerns went, but I'm really good at my job, and I keep quality notes that make it easy to recap a quarter or half. (But like I said, I'm good at my job.) I don't really see what that has to do with focusing your rhetoric on 10% of startup comp as though it were 100% - especially now that your tax discount on cash comp has been restored! - but you're welcome, of course.
steveklabnik · 4h ago
> I keep quality notes that make it easy to recap a quarter or half. (But like I said, I'm good at my job.)
The point is not that my friends don't do a good job, the point is that this is work that does not actually further the organization's goals directly, but is necessary in order to keep their job. They'd rather be doing the actual work they are hired to do.
throwanem · 4h ago
Oh, come on. Administrative overhead is a reality of business everywhere and at every level; the idea that to manage an organization somehow necessarily impairs it is absurd. So is purporting falsely to eliminate that overhead on behalf of others, when basic professional competence instead involves for oneself learning to minimize it - to dispose of it, not by panicking or catastrophizing or sweeping it under a rug, but instead in a fashion such as that I described ie efficiently. To claim otherwise is infantilizing nonsense. It's fundamentally dishonest, though I grant you probably have never before so directly been told as much.
sunshowers · 3h ago
I moved from Meta, infamous for its performance reviews, to Oxide. The culture difference is night and day. The level of self-interested behavior seen at Meta just doesn't exist here.
By the way, I received every rating from Greatly Exceeds (including an additional equity grant) down to Meets Most, and the rating I got overall had very little correlation with either effort or impact. I got Meets Most for some of the most valuable and industry-impactful work I've done in my career, and Greatly Exceeds for something that got replaced in a year.
nemothekid · 3h ago
>I moved from Meta, infamous for its performance reviews, to Oxide. The culture difference is night and day. The level of self-interested behavior seen at Meta just doesn't exist here.
The culture difference between Meta and any startup will be night and day. People who are self interested min-maxxers don't join startups. Not dealing with "corporate politics" has to be in the top 5 reasons anyone leaves FAANG to join a startup. That has nothing to do with Oxide's comp structure.
throwanem · 3h ago
> People who are self interested min-maxxers don't join startups. Not dealing with "corporate politics" has to be in the top 5 reasons...
Oh, sure! Now tell me another one. The idea that startups don't have politics is - well, I'll say it is extremely comedic, and we'll leave it at that.
Think about it for a minute. I'm not questioning the existence of the pipeline here described, and no one is questioning the existence of many pressing reasons for anyone at the FAANG "top of funnel" to want to flow along that pipeline about as quickly as is achievable.
But those "reasons" have effects on the people who experience them, because humans have emotions and psychologies and other such inconvenient externalities, and for like cause those effects are not instantly and perfectly ameliorated in every case by a simple change of environment.
Can you not straightforwardly see how this might produce some extremely adverse results, in a social and sociological sense? And how overt, documented, attributable, and discoverable personnel processes, far from some unreasonable burden, might serve a broadly beneficial role in such circumstances?
sunshowers · 2h ago
This is a reasonable argument. But look, I have my views based on my experiences and things I've heard from colleagues and friends, and you have yours.
throwanem · 3h ago
Well, sure. That's Meta, the model for much of the industry, where that isn't the likewise and just as deservedly infamous Amazon. So when you say Oxide is better, I'm sure I can believe you that it is, but can you see why that still might not convince? It's like if I say I'd rather be beaten than stabbed. Obviously this is the sensible choice to make among the selection given, but still the question might reasonably be asked: can there really be no third option?
steveklabnik · 3h ago
The issue is, you're speaking from the position of the organization itself. Yes, staff work is just as important as line work. The issue with perf isn't that it's staff work, it's that people who are ostensibly hired to do line work are forced to do staff work just to keep their jobs. And sure, you can argue "tough, that's just life," but it's not hard to see why people resent it. They want to be writing code, not putting together promo packets.
Anyway this is mostly just one example, it's just one that comes up often when I speak with my peers about how Oxide works vs other companies.
throwanem · 3h ago
I see why people resent it; I'm saying they're foolish to do so. Why should I not seek involvement in staff work that determines so much of my future? Why should I not make myself responsible for the conduct of the business within the scope of my role, rather than just the parts which I happen to like and enjoy?
And since you can't seriously mean me to believe performance is not evaluated at Oxide, I really can't see how I'm meant to take any of what you're saying at face value. Instead it seems something much akin to "don't worry your clever little head about the boring ol' money stuff, darlin'! Don't you trust me to take good care of you?"
steveklabnik · 3h ago
> I see why people resent it; I'm saying they're foolish to do so.
Okay, sure. I am also not a "I only want to put my head down and code" person either.
> And since you can't seriously mean me to believe performance is not evaluated at Oxide,
Not formally, no. Because there are no levels, no corresponding salary bands, there's no need to have a formal process, with all of the justification work that has to go in from the employee, and all of the reading and evaluating all of that stuff from management.
It is true that if you don't do your job, you'll be let go. However, that's a conversation that would happen between you and Bryan/Steve, not an annual or quarterly process with all of the paperwork and such that those formal processes demand.
Instead, we simply do our jobs, and get paid our salary.
It sounds like it isn't an environment for you, and that's okay.
throwanem · 3h ago
> Instead, we simply do our jobs, and get paid our salary.
And some of "us" have an ownership stake, and some of "us" do not. But "we" like to talk about how everyone's working on a level playing field, anyway.
You're quite right. It isn't an environment for me.
steveklabnik · 3h ago
Small nit, everyone has an ownership stake, it's that some are larger than others.
throwanem · 2h ago
The clarification is welcome, inasmuch at least as it's good to know there are no missing grants. It doesn't really surprise to hear some are larger than others, which is invariably the case, usually by one or two orders of magnitude. I assume you're satisfied with yours.
I wouldn't wish to be taken as saying no employee is ever more valuable to the business than another. That would also be absurd. What I don't understand is why all the circumlocution.
growse · 4h ago
> but I'm really good at my job
How good you think you are at your job is pretty meaningless if some manager above you wants to weaponise the company's perf policy against you.
throwanem · 4h ago
I'm good enough at my job to see that when it's happening. That's one reason why I didn't say 'I think.' Another is because I know the way to bet is that, with this weapon forbidden, others will be found to replace it. Why go into any of that without even the promise of hazard pay? I'd rather just do honest work.
bcantrill · 2h ago
This "job" that you speak of, that you are so good at. Are you... at it now?
throwanem · 2h ago
> This "job" that you speak of, that you are so good at. Are you... at it now?
Hello, Bryan! No, I'm on my own dime, no one else's. But it's decent of you to show such concern over my situation, in these uncertain times.
givemeethekeys · 4h ago
As long as the equity grant is the same as the founders, I as an independently wealthy person am happy to join the team that gives everyone the same salary.
Because, you know, you better have the same amount of skin in the game as I do.
diggan · 6h ago
> If I wasn't paid, I wouldn't work for them.
That's great, but useful to know not everyone thinks the same. When I transitioned to software development (from basically random "whatever pays my rent" jobs), besides my first software job, they were all because I liked the particular product in some way or another, and what the compensation was is basically the least interesting thing for me.
Of course, some level of base payment is needed, because I still needed to pay rent, but if I was choosing between two jobs where one was utterly boring but paid 3 times more than a fascinating job, I'd take the latter in a heartbeat. And no, I'm just an individual contributor who wants to like what I work with, not an executive, manager or similar.
mystraline · 6h ago
The hypothetical situation you set up is interesting, in that past a base amount of money to survive and thrive, that you would choose the more intellectually stimulating position. And I do get that.
For me, if the hours were equal, I would choose the higher paying one. And then, I would create and make outside of work. And since I have that much higher wage, it could be a jump start on my own business.
And, enough money can buy independenance in that you can get this flexibility of doing as you choose.
diggan · 5h ago
> For me, if the hours were equal, I would choose the higher paying one. And then, I would create and make outside of work. And since I have that much higher wage, it could be a jump start on my own business.
Yeah, I guess I've been lucky to be able to chose daily jobs in the past that basically gives me what you would create outside of work, except I got a fixed payment each month for doing something I really enjoyed. So I never had the need to do that stuff outside of work to derive enjoyment of most of my time, which I guess is my top priority and been most of my life.
duped · 5h ago
That's reasonable, but signalling this to a startup during hiring is going to be a negative. There are three kinds of capital they get to play with, cash, equity, and culture. Cash is the least pliable of the three to them, equity the least liquid, but culture is actually something they can control.
If you have a team full of people who are just there for the paycheck, the only thing that will keep them there is increasing the paycheck. Which startups can't do in a crunch.
baq · 5h ago
Culture is smoke and mirrors. When investors say frog, founders jump and guess who gets the cultural shaft then.
Better to be thinking in transactional terms from the get go especially in early startups, where majority of total comp is an illiquid call option.
duped · 4h ago
I mean it's not smoke and mirrors, when I'm picking between jobs I'm strongly considering the people I'm spending 35-40% of my waking hours interacting with. If I cared solely about maximizing personal returns I wouldn't work for startups.
evantbyrne · 5h ago
> but if I was choosing between two jobs where one was utterly boring but paid 3 times more than a fascinating job, I'd take the latter in a heartbeat.
I chose my current job against competing offers because it was a good thing for the world, but I would not have taken significantly reduced pay for it. Let me tell you why: nobody that insists on paying you below market rates is going to treat you right. Some of the worst professional interactions I've ever dealt with involved high ranking individuals at nonprofits. These were orgs may have had genuinely good missions, but also paid rank and file employees quite poorly. On the other side, the 3x above market rate job is just a fantasy. I could believe it if you were talking about a 20% bonus.
matwood · 4h ago
I hear you, and I've never solely chased money either. But, we unfortunately live in world driven by money, and if I'm going to pour myself into work I want to be compensated appropriately. I also have a huge issue with feeling like I'm getting taken advantage of. So, what I have done is try to find jobs where those things align somewhat.
mlyle · 6h ago
I think we live in a better world when the primary motivator for how we spend half of most of our working day isn't doing what's necessary to get strips of paper for survival.
That is, the work itself should be interesting and fulfilling.
Yes, we need money, but when the work relationship approaches being purely transactional the whole thing is demeaning for everyone and less effective.
Boy, it takes a lot of luck and skill and privilege to be able to shop for (or offer) work like this, and money is still important.
Keyframe · 5h ago
If I wasn't paid, I wouldn't work for them.
While this is true for most of the cases, it's not the case always. There are definitely jobs I'd work for less than I make at the job now and there are jobs which are considered "dream jobs", but ultimately there needs to be a solid base to make you and your family feel comfortable if you're spending at least 1/3 of your day on.
inerte · 5h ago
They know it's a lie but still need to say it.
I used to have a manager that gave me this line. He left this company to join another one, had multiple offers, and told me he accepted the highest one because "it's all about the money".
They know, we know, everybody knows, but that's not the playbook.
conjectures · 6h ago
> There was discussion about how they thought candidates asking about compensation to be something of a negative signal
It's not an unusual way of thinking, but every time I see it, it seems bizarre to me. If the candidate was to propose any project once hired, I'm sure these folks would want them to think about costs and benefits.
This policy selects either for people unable to reflect on their life with the same wit they apply to work; or people who will front about their motivations. Both seem like poor outcomes.
tshaddox · 5h ago
> There was discussion about how they thought candidates asking about compensation to be something of a negative signal because they wanted people who weren’t in it for the money, basically.
I think companies avoiding discussions about compensation is a negative signal, because they’re only in it for my labor.
oooyay · 3h ago
> The old Oxide compensation discussions were interesting. There was discussion about how they thought candidates asking about compensation to be something of a negative signal because they wanted people who weren’t in it for the money, basically.
I can't say anything of Oxide because I don't really know the people involved other than reading their writing.
This is an attitude a lot of industry veterans have. Most of them were in software pre-2015 and have long made their money and paid their debts. They saw the haydays of job hopping, massive salaries, massive equity, and "rockstars" (that never were). The people I know that joined software post-2015 and onward are not in the same financial position.
ethbr1 · 6h ago
Anyone who doesn’t ask about compensation (at least at a later point in the interview process) would be a red flag to me.
Most valuable people know they’re valuable, and do (and should!) negotiate compensation.
steveklabnik · 6h ago
I am not sure I fully agree with the characterization above (that asking about salary is a 'red flag' in our process), but if I had to try and steelman it: we prominently put
> Everyone at Oxide makes $207,264 USD, regardless of location. (Some sales positions have a lower base salary and contain a commission component.)
It's also a pretty well known aspect of the company. Combine this with the fact that our hiring process is different, where interviews are the very last thing before possibly being hired, and someone who has missed this fact could come across as having not done some very basic research about the company that they're applying to.
To be clear, I still think calling it "a red flag" is a stretch. I fully agree with you in a general sense, for places that are willing to negotiate compensation in the first place, but we make it very clear up front that we do not.
Aurornis · 5h ago
> (that asking about salary is a 'red flag' in our process)
> To be clear, I still think calling it "a red flag" is a stretch.
In my comment above I did not call it a "red flag". My specific wording was "somewhat of a negative signal". That seems consistent with what you said about judging someone for asking about a well-known aspect of the company because it signals they haven't done enough research.
It also dodges the question that keeps getting asked: Does everyone receive the same equity compensation as well? As far as I can tell, that question is not answered on your website. Asking it seems like fair game.
steveklabnik · 5h ago
> In my comment above I did not call it a "red flag".
The person I was responding did, you are right that you did not.
> It also dodges the question that keeps getting asked:
This question gets asked in every thread about this, nobody is trying to dodge anything. The equity portion is variable, and the salary is identical. We do not do bonuses.
cestith · 5h ago
I think in general, at many companies a candidate asking is a red flag. Also for many candidates a company not wanting to discuss it until the offer is a red flag.
It seems that specifically your open disclosure very up front bypasses at least most of this from both sides.
ghaff · 6h ago
FWIW, my last job I didn't negotiate. Company I really wanted to work for. Wanted to close the deal. So I didn't gum up the works with salary negotiation and it ended up being very good for me in a lot of ways.
Aurornis · 6h ago
Red flagging a candidate for not asking about compensation during the interview is not a good practice. This is an example of penalizing people for not following a specific script or candidate archetype you have in mind instead of judging them by their skills and abilities.
ge96 · 6h ago
self esteem problem ha (not asking or thinking low)
999900000999 · 5h ago
At this point I've accepted most equity comp in a non public company is worth less than toilet paper.
When it comes time to actually cash out or you notice some animals are more equal than others, the excuses start. The drama happens. No one knows what the equity is worth. If you try and advocate for yourself you'll be told the equity is actually worthless.
From here the 200k salary seems fair. Just don't live in SF. Chicago , Philly, Pittsburgh, Cleveland, quite a few cities are perfectly livable on 200k.
In fact, in any of the above metros you will be living nice.
timerol · 1h ago
> Does everyone at Oxide have the same equity grant?
> equity compensates for risk – and in a startup, risk reduces over time: the first employee takes much more risk than the hundredth.
I think that paragraph answers the question pretty clearly. As an Oxide employee you will get equity. It will generally be less than the people that came before you, but more than people that come after you. So it's obviously not the same as everyone else
singron · 1h ago
"total comp" (salary+equity) is really hard to quantify for a private company. In order to qualify as ISOs, the stock options need to be priced at the Fair Market Value (FMV), which makes them essentially worth ~$0 on paper on the day they are granted. In order to value them differently, you need to guess if/how the company will increase in value in the future. If the gains were guaranteed, then that should be factored into the current FMV, so options always have significant uncertainty.
This is unlike an RSU from a public company, where you can sell the value of your shares as they vest and add that to your income with minor risk of price volatility.
illegalmemory · 7h ago
They have since updated it slightly
> Since originally writing this blog entry in 2021, we have increased our salary a few times, and it now stands at $207,264. We have also added some sales positions that have variable compensation, consisting of a lower base salary and a commission component.
ekianjo · 7h ago
so basically everything converges to having specific reasons to have different salary schemes.
ArnoVW · 7h ago
One exception, for sales. I don't see how they could have done it differently.
We have a "one rate per level" rule. The rates are published, and so are the definitions of the levels, and everyone's level (i.e. indirectly you can know everyone's salary)
Worked great, untill we started to look for sales. Doesn't work. They only know incentive-based schemes.
So now they have an incentive-based scheme just for the sales, which is (essentially) budgetted from their stock-option package (that everyone gets). I.e. they benefit from growth a little bit earlier and directer.
If we hadn't done that, we wouldn't have a sales department.
abxyz · 6h ago
I argued this in the previous discussion about oxide’s compensation structure: I disagree that sales must be commission based. Yes, finding sales staff that are willing to work for a salary and equity shrinks the pool but the same is true of engineers willing to work for a flat rate across the company.
Sales might seem mystical and magical to engineers but it isn’t. A small company with a small sales team can absolutely work without commission. Yes, it is harder, but it is not impossible. The carve out for sales undermines the ideas behind a flat salary structure. Just because we can measure a sales person’s contributions in dollar amounts does not mean we must measure it in dollar amounts. Sales is as much about the partnerships between sales people and product/engineering, why aren’t all the people who work on a deal getting commission?
I’d go as far as to argue that oxide is in the perfect position as a big-ticket long-cycle business to abandon traditional sales commission structures. They take on all the negatives (sales people overselling to get commission) with no benefits. There are other ideas. Company wide bonus based on sales made during the year?
yencabulator · 3h ago
> Just because we can measure a sales person’s contributions in dollar amounts does not mean we must measure it in dollar amounts.
I don't even know if we can.
Yes, you can measure the number of deals signed they called dibs on. But:
1. You don't know if the salesperson earned it, or the whole product. There's a baseline demand driven by the whole company. This is the whole old argument that nobody can prove that ads work; you just can't pinpoint the purchase decision to exposure to an ad. So yeah I guess you can make your salespeople compete against each other and reward the one who stochastically floats to the top while punishing others. Sounds like such a fun workplace, I thought everyone agreed Microsoft's rank system sucked.
2. Several times I have witnessed salespeople selling non-existent, non-planned, functionality and forcing the rest of the company into crunch mode to not have a major client semi-publicly end the contract early. You're often just rewarding the biggest liar while everyone else has to cover up for their shit. Once again, sounds like such a fun workplace.
It comes down to, competitive sales is a cancer, and you're choosing to have it.
tock · 6h ago
> Just because we can measure a sales person’s contributions in dollar amounts does not mean we must measure it in dollar amounts.
This is the fairest form of compensation. It's unfortunate that engineering contribution cannot be measured the same way. If we could engineers would all be getting a nice pay hike.
tshaddox · 3h ago
It's still just a market. You've got to make offers that people will accept. It's mostly silly to try to come up with some objective theory of value, except in the context of what potential employees will consider to be fair, which is right back at "you've got to make offers that people will accept."
Basing compensation on supposedly objective things like "the dollar amount a sales person brought in" might be important to a given pool of potential employees, but resist the temptation to think of it as objectively determining the value of the employee's work. Remember that all you're doing is making offers that people will accept.
tock · 3h ago
I agree. But if employees know their objective value I believe it will change what they will consider an acceptable offer.
yencabulator · 3h ago
Only if the salesperson also implements & supports the things they sell. Selling false promises of something the rest of the organization has to fulfill is not fair -- but that's the way to the biggest commission!
ghaff · 6h ago
And many would be getting let go because they weren't meeting some number.
tock · 5h ago
Companies already do layoffs without commissions. They are always optimising to reduce salaries and increase profit margins. And its not "some number". Its the amount of $ brought in. Thats what companies care about.
ghaff · 5h ago
Yes, but sales reps have very specific targets and sales managers have no problem routinely letting people go if they miss those targets. It really is a somewhat different situation from engineering--although projects, for example, certainly get canceled and teams let go. There's a more direct correlation to quarterly revenue/margin input in the case of sales.
tock · 5h ago
But its a more transparent system. Right now no-one has any idea if they get laid off or if they are being underpaid. I think the overall compensation would likely go up if you are good at your job.
liamkinne · 7h ago
Yes, but you aren't wasting time early on negotiating compensation.
IncreasePosts · 6h ago
Why is sales special? Why not just have some performance bar for that, just like all the other positions?
castlecrasher2 · 6h ago
Because good sales staff make a ton of money through a ton of sales. Any other incentive structure is unlikely to attract high performers.
bobsomers · 21m ago
How is this not exactly the same in engineering though? Performance reviews at top tech companies are pretty much designed to identify the super high performers and shove massive bonuses and equity grants their way.
And those equity grants are effectively as good as cash, since they are publicly tradable stock.
darren0 · 6h ago
It's pretty fundamental to the personality of people in sales to be driven by getting the sale and getting compensated based on the deal size. If you remove that carrot, it just doesn't work. Some sales people will make millions, some will make nothing.
diggan · 6h ago
> If you remove that carrot, it just doesn't work
How come it works for basically every other job on this planet? Developers aren't paid per feature implemented/bug fixed, and we still do those things, how come sales people are unable to do things for a fixed monthly salary?
jasode · 5h ago
>, how come sales people are unable to do things for a fixed monthly salary?
You have to separate out 2 different ideas of the "theoretical idealized salesperson that works for fixed salary" -vs- "real-world salesperson that works for variable commissions".
The businesses that have attempted to pay fixed salaries for salespeople end up attracting incompetent salespeople who can't sell. They become a negative cost on the company's payroll because they can't bring in any revenue. In contrast, the high-performance salespeople (the "rainmakers") are attracted to the variable high-commission, because they know they have the hard-to-find skills to actually sell and bring in the money. If a salesperson has the skills to get a customer to sign a contract and pay money, they have the leverage to get a percentage of that.
Developers, db sysadmins, tech support staff, etc are not in situations to directly influence and shake the hand of a new potential customer and convince them to write a check.
ChrisMarshallNY · 6h ago
Sales works that way in every industry.
A top salesman can make more than the CEO from commission. Many top salespeople have a zero base salary.
The pressure is pretty crazy, though. I’m not cut out for that kind of thing.
diggan · 6h ago
I do know that (I myself also worked in sales for a short stint, unrelated to software though), what I don't understand how these magical "sales people" apparently can't work for a fixed salary when literally everyone else can. Apparently the rest of us can do high quality work without being paid for each feature/bug fixed, yet these individuals cannot?
> Many top salespeople have a zero base salary.
Hmm, probably true in some places, but here (Spain) that wouldn't even be legal. When I worked in sales we had minimum wage + commission, but I'm sure the salary would be 0 if they were allowed to set it up like that.
ChrisMarshallNY · 5h ago
I have a few [wealthy] salespeople friends. Most have “commission-only” (0 base) jobs.
Many jobs will start you with a base for a few months, while you build commissions, but they stop it, after a while.
They can also get fired at the drop of a hat. Not much job security.
Sales are easy to convert to incentives. Just take a cut of the sale. It’s not so easy to calculate value from other jobs.
Aurornis · 5h ago
> Hmm, probably true in some places, but here (Spain) that wouldn't even be legal. When I worked in sales we had minimum wage + commission, but I'm sure the salary would be 0 if they were allowed to set it up like that.
In the United States having "zero base bay" is hypothetical. If a full-time employee had no commission payouts they'd be compensated minimum wage as necessary to comply with laws.
Sales jobs often come with a warm-up period with either a higher base salary or they get paid part of their commission target for a number of months regardless of how many sales they make.
marcusb · 4h ago
> what I don't understand how these magical "sales people" apparently can't work for a fixed salary when literally everyone else can
It isn't that "sales people"[0] can't work for a fixed salary. The good ones just won't because they can find another employer that will pay commission, and they know they will make more with commission than without.
Employers will pay commission because that's how you attract the best sales people, and the best sales people are worth orders of magnitude more to their business than average sales people. Despite how much they earn, in general and compared to their average peers, the best sales people don't cost orders of magnitude more (5x is a more typical spread in tech sales.)
The advantage of 100% commission -- where it is legal -- is pretty obvious from the employer's view point. The company only pays for production. These sales people are commonly (but not always) independent contractors. The benefit for the sales person is a little less obvious, but, generally, they have more autonomy, a simpler comp plan without any caps, and earn more per dollar sold than they would on a base + commission plan.
0 - whether magic or not
geodel · 5h ago
> the rest of us can do high quality work without being paid for each feature/bug fixed, yet these individuals cannot
Yes they can not. It is not high quality work but high quality results for sales guy. Developer work is complete once service deployed. It wouldn't be developer failure if user volume doesn't reach x thousands per day on their web service. It would definitely be salesman failure sales does not reach x dollars in certain duration.
Developer equivalent of sales would be to say "I have distributed x sales brochures and call x number of clients this month. My job is done."
Aurornis · 4h ago
Sales is unique because the monetary benefit to the company is mostly objective: If someone closes a $10 million sales contract, that becomes $10 million in revenue.
If a team of developers work together to fix a bug, how would you calculate the revenue value of the bug and how would you distribute that to the team that solved it? Technically the value of a bug is negative because it costs the company, so do you subtract that from the pay of the engineers he worked on it? If 5 people implement a feature that uses a library developed by 5 other people, which was built on the platform team's infrastructure, how do you divide up the commission? It doesn't work.
tshaddox · 3h ago
A $10 million sales contract is objectively $10 million in revenue, sure, but it's silly to attribute that entirely to the sales person just like it would be silly to attribute it entirely to the engineers that built the product or the marketing team that bought billboards.
cestith · 5h ago
Freelancers and consultants do absolutely have the option to get paid by the feature. It’s exceedingly rare for internal employees or contract employees though. That means there’s no market competition based on it yet. Some places do have bonuses or even profit sharing. Some senior ICs and many managers across the industry can get equity through either grants or options.
Sales professionals have a lot of different places they can sell things. The market-rate compensation for sales includes commissions. So to get the best sales people, you want something easy and exciting to sell with a good commission structure tied to the sales.
bpt3 · 6h ago
It's not that they're unable to; it's that the field attracts people who are financially motivated and other companies have compensation structures that reward personal performance.
Top salespeople generally won't work for a fixed salary because they want to make as much as they can, and the way they do that is by having as much of their compensation tied to personal performance as possible.
I personally think more engineers/developers should think the same way, but it's also much harder to directly tie job performance to compensation when contributing to a product.
diggan · 6h ago
> because they want to make as much as they can
But that's the same no matter if you work in sales, customer support or many other roles, a lot of people just care about the money with little regards to anything else, yet the sales department are the only ones who must have commission?
bpt3 · 5h ago
> But that's the same no matter if you work in sales, customer support or many other roles, a lot of people just care about the money with little regards to anything else,
It's actually not the same for many roles. See the comments from people in this thread alone who scoff at the notion of maximizing compensation. I don't get it personally, but it's not an uncommon thought.
> yet the sales department are the only ones who must have commission?
I think there's a very high likelihood that a salesperson is primarily driven by compensation, and good salespeople will already be working in a commission-driven compensation model elsewhere.
Why would a top salesperson at Dell, HPE, Oracle, or wherever else a hardware salesperson comes from move to Oxide to take less money and completely decouple their compensation from their performance?
cestith · 5h ago
Even if your intent is to maximize income in customer support, you often don’t have the market option to do that. I have seen (and even worked at) places where chat support, phone support, and support administrators have a quota of chats, calls, or ticket responses and make bonuses based on how much they exceed their numbers. Unfortunately sometimes that results in people updating tickets several times an hour saying things like “we’re still looking into this and haven’t forgotten you” without actually looking into anything.
One place I worked I tried to move the quota system more towards being the final response on a resolve issue, but upper management didn’t want to ever judge whether an issue was resolved even when the customer said they were happy. They did incorporate an NPS query for every interaction, though, and a multiplier against the volume-based quota. Unfortunately that favored people who were good BS artists when lying to the customer about looking into things.
The fallout from the above paragraph was that quality, caring staff would get punished for actually solving customer problems.
bpt3 · 3h ago
Almost every other role is at least one level removed from putting cash in the company's account, which is what leads to the shenanigans you described with metrics that are a poor proxy for revenue generation (and/or are too easy to game).
speed_spread · 5h ago
Because sales are quantifiable and directly mapped to performance.
To get that kind of proportional payback in engineering you'd need very clear financial objectives for a project. I could see that happening in optimization scenarios where consultants are brought in and get paid for whatever they can trim from operational costs.
cestith · 5h ago
In fact I’ve seen both tech and manufacturing efficiency consultants whose quotes include $x up front plus monitoring and reporting that shows the efficiency gains. Then rather than taking a closing fixed payment, they get a percentage of the savings to the client over the first six or twelve months.
OkayPhysicist · 5h ago
The key difference between everyone else in a company and Sales is that Sales is where the money comes in, directly. It's approximately trivial to point at a sale, see how much money it made, and then who made the sale. So commission is a natural compensation structure for salespeople. For everyone else at a company, their individual contribution to the company making money is a lot more diffuse, and any metric you might be tempted to try and put a commission on is at risk of being gamed. Whereas "how much $$$/worth of stuff did we sell" is pretty much THE metric by which we judge a business as a whole.
rubicon33 · 6h ago
If you’re asking this question then you have really no idea how the sales engine works at a company. It’s inherently incentive driven.
sofixa · 6h ago
Because sales people are used to work on incentives, including going over and getting rewarded for it.
If they have a fixed salary with a high objective to "make it" (e.g. if you sell less than $X, you get fired), lots of sales folks will skip on it because they can't go over, and most probably prefer to have a quarter or two or year at e.g. 70% salary while working on longer term deals, rather than losing their job for not being good enough within that arbitrary time period. And going over their quota can be wildly lucrative depending on the terms.
Quarrel · 6h ago
FWIW, it seems like nowhere is this truer than SF/SV.
Outside the bubble, it isn't always the case, or the structure can be a bit different, but salespeople in the Valley (as it were) are a different breed.
cestith · 5h ago
Ask a local real estate agent or real estate broker how much base pay they make. Or, heck, a car salesperson or an ad salesperson at your local TV or radio station. It’s all commission-based. In some of these fields in the US the norm is 100% commission-based with no base pay. In others someone might make one to three times minimum wage, but will end up being some of the highest-paid people in the company based on commissions of anywhere from 1% to 50%, depending on the industry.
sofixa · 6h ago
No, it's just how sales works, it's almost always on commission.
vlovich123 · 2h ago
Tesla salespeople do not work on commission. Also you can align incentives through stock grants which appreciate by you selling more.
sofixa · 18m ago
> Tesla salespeople do not work on commission
I work with tech salespeople with a variety of former employers as tech sales people, and I've never heard of anyone having worked without a commission. I'm vaguely in tech sales myself (solutions architect) and I'm on commission too, and so is everyone who joins our division from similar employment (solutions engineers/architect, or even customer success folks).
Aurornis · 6h ago
Sales has been commission-based everywhere I’ve worked, including companies based in other countries.
Commission based sales was definitely not a Silicon Valley invention.
hiddencost · 6h ago
Sales culture is heavily incentive and performance based.
It sucks but they like to think that if they work harder they'll get paid more.
ghaff · 6h ago
It's not universal but B2B sales in particular have evolved to incentive/performance compensation to a large degree. Wasn't always the case but (most?) of those companies aren't in business any longer. Also extends to the sales hiring process. Not that companies don't look at track records but it's also the case that sales managers don't have any issue firing people who don't meet their numbers.
Etheryte · 5h ago
Out of curiosity, how would you imagine that working out, technically and specifically? You start out with founders having equity, and maybe some early investors. Then you employ some people and... what happens exactly? Are new shares created, is everyone who was already onboard slowly diluted, what happens when someone joins and leaves? Etc, I don't think there is an approach to this where all sides would be happy, so I'm interested to hear your thoughts.
steveklabnik · 5h ago
Not your parent, and not suggesting in any way that Oxide is one, but the key term you want to search to learn more about that kind of arrangement is "worker owned cooperatives." There's a lot of variety in how it's handled.
dustingetz · 7h ago
indeed, founders are generally compensated at half the competitive rate
kortilla · 5h ago
This has been the biggest red flag to me about oxide since these blogs came out. You don’t join a startup for salary and every startup I’ve been at that emphasizes fair salaries is doing that to intentionally discourage people from pushing on total compensation.
Employees apart from the very early ones are likely really getting fucked on equity because oxide explicitly treats candidates asking about equity as a red flag.
Companies structured like this end up turning into a combination of rich people who don’t need money and are just interested in the problem space and then mediocre people who can’t get a better offer. (If you are good, remote work with high TC is definitely available.)
Unless Oxide is giving out huge equity bonuses for good perf (which would make their comp post hypocritical), it’s going to have a continuous talent decline as it grows. There aren’t enough independently wealthy high performers interested in what Oxide is doing to sustain a talent pool.
mwcampbell · 37m ago
> (If you are good, remote work with high TC is definitely available.)
But how good do you have to be at things other than the work itself (edit: and how lucky as well) to land one of those jobs with higher compensation? For someone outside of high-cost-of-living tech hubs, Oxide's fixed salary could be life-changing all by itself, even with minimal equity. The fact that they take that deal doesn't necessarily mean that they're mediocre.
actionfromafar · 7h ago
That would be even more outlandish, I don't think that's possible.
lumost · 7h ago
It depends, there are certainly founders who come from sufficient money that the value of founding a unicorn is not material to their Net worth.
However I’d also suggest that the concentration of tech in the last decade is also partly due to startups chronically stiffing their employees on equity. The difference in compensation potential naturally forces a talent split where talent joins larger and much better compensated firms.
NewUser76312 · 7h ago
Of course not, what's the purpose of asking such as silly question?
Are you being snarky and suggesting that employees deserve the same upside that founders deserve?
diggan · 7h ago
> Of course not, what's the purpose of asking such as silly question?
How is it silly if they already do that for salaries? Co-ops with equal ownership isn't unheard of, and isn't silly at all.
AngryData · 6h ago
Yeah they aren't unheard of at all, co-ops have had slow but steady growth in the market for some decades now.
cpach · 6h ago
I’m not sure I follow. In what market(s)?
aapoalas · 5h ago
One famous example is Igalia, doing Open Source consulting for various companies, including Google, Apple, and others.
They're a worker owned co-op and have grown very nicely over the years.
cpach · 4h ago
Igalia are very cool! Not sure if it’s so easy to reproduce their success (if I’m wrong on that point, that’s only good I guess).
Aurornis · 6h ago
> Are you being snarky and suggesting that employees deserve the same upside that founders deserve
The founders are excluded from the employee compensation discussion. They own the company because they founded it. Nobody thinks they just put the equity into a structure that nobody owns.
The question is whether all employees are compensated equally, which is a very important detail. Giving everyone the same salary is very different than giving everyone the same total compensation.
TrackerFF · 7h ago
A company can't function without employees, so why not?
shortrounddev2 · 7h ago
Salary and equity have nothing to do with what you "deserve", only what you're able to negotiate.
lumost · 6h ago
For early/mid stage startups - this is an awful position to take. These orgs are heavily influenced by who they hire - what you pay defines your incentive structure.
Does the world class engineer or business development lead just take it easy and travel around after they join?
Does the new manager push the team and business forward or prioritize stability?
Do engineers spend their time on reactors and impressive sounding projects or figuring out what customers need?
Do people feel lucky to have a seat in the org or do they spend their time complaining and looking for the exits?
Money isn't the only lever, but its a strong one - startups will never compete with established firms on cash outlays.
shortrounddev2 · 2h ago
People are paid salary and awarded equity based on supply/demand for labor, the marginal product of that labor, and the amount of risk engineers are willing to accept by joining a startup. It's an economic transaction, the same as buying office equipment and signing contracts for cloud resources. Trying to imbue mysticism into it is just asking to be lied to by your employees
lumost · 1h ago
There is no mysticism in incentive structures. My point was rather that if you provide strictly below market compensation (as most startup equity is positioned these days). You are likely to get below average talent, or below average results from poor incentives.
maerF0x0 · 7h ago
Would love to engage in a discussion with you on this. How would you describe "deserve" in the sense of compensation? I agree with your premise that what you get is ultimately bound by the ceiling of the payer's generosity and your ability to negotiate.
But what sorts of things input into the function of "deserve"?
shortrounddev2 · 3h ago
Everyone deserves healthcare, a place to live, food to eat. Some people deserve to live happy lives and some people deserve to rot in prison. These are about your personal conduct and how much you contribute to society.
How much equity or salary you get in a company is a function of supply/demand and the marginal product of your labor. I would say there are probably fewer CEOs who can take a company from startup to unicorn status than there are really good founding engineers out there, so CEOs tend to get more equity in a company. Sometimes the founding engineer knows something that nobody else in the world does, so their equity reflects that. It's also a reflection of how much risk the engineer is willing to take on (they'll probably take a salary cut to be a founding engineer, and they also risk the company randomly running out of runway and finding themself suddenly unemployed).
But it has nothing to do with what you deserve. Maybe if the CEO/President is a sentimental type, he'll award you equity based on how much he feels you deserve but ultimately it's about supply and demand.
If a CEO puts in 90 hours a week at a tobacco company while his engineers put in 20 hours a week, does he deserve lots of money (and therefore a more comfortable life) because he puts more effort into killing people? Or does he deserve every bad thing that happens to him because he decided to spend his limited time on this earth making it a worse place?
lostmsu · 6h ago
A lot of people with broken /s detector are replying to this comment.
diggan · 6h ago
It would seem like parent's something detector is off if they think the grand-parent's comment was snarky.
sneak · 7h ago
That isn’t a snarky position; early employees in high output orgs like this generally work just as much as founders do.
The founders aren’t really taking on that much more risk than the rest of the early team; it’s the VC’s money, not theirs.
I absolutely don’t agree with the idea that employees deserve the same upside as founders (because I think initiative and persistence against adversity/inertia is insanely rare and valuable and should be rewarded immensely), but it is not an insane proposition.
It’s especially popular among people who think the actual work output is more important than the leadership initiative. Both are obviously essential, and founders do both, while employees do only the first (or they’d be founders themselves).
no_wizard · 6h ago
>rewarded immensely
Let’s define this. Let’s say 1:25? 1:50? What ratio is appropriate?
sneak · 4h ago
We don’t need to define it; employees define it by who they choose to work for given the equity granted to them by the founders.
If they didn’t like the deal, they would become founders themselves, or choose a company that offers a better deal.
It turns out that leadership drive and the compulsion to bring something new into existence from scratch is actually quite rare.
Your figures seem to be roughly in line with what the employment market has settled on, although price discovery could be better (most employees don’t get to see the cap table during hiring negotiation, which, IMO, is wrong).
siliconc0w · 7h ago
Pretty bullish, anyone who has tried to setup and manage their own compute knows the pain they're solving.
Plus I predict more companies will exit the cloud once they realize how thick the margins have become or want better guarantees over sovereignty.
jillesvangurp · 6h ago
I actually think that having more cloud providers might deflate a lot of the pricing. If you think about it, companies like Amazon buy server hardware and then rent it out by the vcpu (with throttling if they can get away with it) per month. Add memory and IO and you are looking at bills that pay for the server in mere months/weeks several tenants carving up all the hardware and each paying tens/hundreds per month.
There are of course benefits to using cloud based VMs and I use them as well. But you are paying a very steep premium for what is a pitiful amount of compute and memory. There's a lot of wiggle room for price decreases and the only thing preventing that is a lack of competition. There's a reason Amazon is so rich: nobody seems to challenge them on AWS pricing. There's value in having them do all the faffing about with hardware of course. That's why companies use them. I'm in GCP; but same principle. I don't want to have to worry about replacing hard disks in the middle of the night, deal with network routers that are misbehaving, cooling issues, etc. That's why I pay them the big bucks. But I'm well aware that it's not that great of a deal.
I used Hetzner a decade ago and paid something like 50 euros per month for a quad core xeon with a raid 1 disks, 32 GB, etc. Bare metal of course. But also, 50 euro. We had five of those. Forget about getting anything close to that with modern cloud providers for anything resembling a reasonable price. Your first monthly bill might actually add up to enough to buy your own hardware. Very tempting. They have beefed up their specs since then. You now get more for less. And they also do VMs now.
throwup238 · 5h ago
I knew it was bad but I didn’t realize just how bad the pricing spread can be until I started dealing with the GPU instances (8x A100 or H100 pods). Last I checked the on-demand pricing was $40/hr and the 1-year reserved instances were $25/hr. That’s over $200k/yr for the reserved instances so within two years I’d spend enough to buy my own 8x H100 pod (based on LambdaLabs pricing) plus enough to pay an engineer to babysit five pods at a time. It’s insane.
With on-demand pricing the pod would pay for itself (and the cost to manage it) within a year.
wordpad · 2h ago
That's just hardware. If you need to build and maintain your own devops tooling it can balloon in complexity and cost real quick.
It would still likely be much cheaper to do everything in house, but you would be assuming a lot of risks and locking yourself in losing flexibility.
There is a reason people go with AWS over many competing cheaper cloud providers.
time0ut · 4h ago
In my experience, companies seem to want to pay the cloud provider tax in order to avoid capacity planning. Sometimes it makes sense because it is hard to predict when something is going to take off. I have also worked at companies with very predictable growth paying insane amounts. I didn’t understand the logic, but they still were profitable and paid well so whatever.
bambax · 5h ago
At the (very) low end it's pretty easy to build your own "cloud" with a NAS, containers, and reverse proxies and tunnels to the outside world. And this will get you suprisingly far.
But at the high end, I think the market is litterally infinite. Every large company should want this, and want it now. Cloud providers are extremely expensive and, outside of the 1-tier where prices are really outrageous, they perform poorly and often offer little support.
This really feels like the future.
boricj · 4h ago
> At the (very) low end it's pretty easy to build your own "cloud" with a NAS, containers, and reverse proxies and tunnels to the outside world. And this will get you suprisingly far.
Anyone can throw together a bunch of parts and software to run Internet-facing services from a closet. That doesn't mean that you're safe from issues that Oxide aims to solve, especially at that small scale.
My homelab (which hosts my blog and a couple of other things) runs off a Topton N17 micro-ATX motherboard ordered on AliExpress, featuring an AMD Ryzen 7 7840HS. Yes, that's a mobile CPU shoehorned onto a desktop platform with a funky mounting bracket to take AM4/AM5 coolers.
Anyways, I wanted to run SmartOS on it, but this system is so janky that the Illumos kernel couldn't find any PCIe devices at all. After spending an afternoon reconfiguring PCIe bridges by hand with the kernel debugger in an attempt to troubleshoot PCIe initialization, I gave up and installed Proxmox.
Admittedly, as far as janky hardware this takes the cake, but the point stands. To paraphrase Bryan, buggy firmware is the sysadmin's worst enemy.
naikrovek · 4h ago
like us old assholes were saying when the cloud really started to take off: "this is nuts, it's just someone else's computer! and they're making a profit off of this service, meaning it's more expensive than what we were doing!"
Now a lot of the things that were done pre-cloud were done in bad ways, and I'm not saying that we were right about those things. Having APIs for provisioning and monitoring are far better than submitting a request to some queue and having your VM provisioned manually 1 week later by someone who gets a key detail wrong. APIs and granular permissions are how this should be done, and "the cloud" taught everyone that very early. But a lot of companies are really stuck in the cloud mindset now, and won't let go of it.
I think companies like Oxide and product lines like theirs are going to start becoming common. Microsoft, of course, completely fumbled the ball with Azure Stack, and I've never even heard of anyone deploying AWS Outpost, both for the same reason: the costs for these are absolutely insane for what they provide.
What most folks really want is their own infrastructure running their own stuff using APIs that are either written in-house or provided by some vendor. Oxide is betting that they can sell you a working scalable system for less money than it would take to hire a team to write the APIs that would allow a company to do the same with off-the-shelf hardware. I think that they're probably right about that.
jeffbee · 4h ago
> they're making a profit off of this service, meaning it's more expensive than what we were doing!
I hope you can see that this is a logical fallacy known as "zero-sum thinking". It is not only possible for a business to profit while lowering prices, it is universal throughout the economy. Tomato farmers make a profit selling tomatoes at a price much lower than the cost to grow tomatoes at home. Bakeries radically undercut the cost of home baking. It is obviously cheaper to buy motor fuel at the gas station than it would be to buy crude and refine it yourself.
The main reason people think their on-prem is cheaper than cloud is that they are bad at accounting.
> [2023] 37Signals expected to save $7 million over five years by buying more than $600,000 worth of Dell server gear and hosting its own apps.. [2024] update: it's more like $10 million (and, he told the BBC, more like $800,000 in gear). By squeezing more hardware into existing racks and power allowances.. transferring its 10 petabytes of S3 storage into a dual-DC Pure Storage flash array, 37Signals expects to save money, run faster, and have more storage available.
steveklabnik · 3h ago
So, to dig into (and maybe stretch) one of your analogies a little bit:
> Tomato farmers make a profit selling tomatoes at a price much lower than the cost to grow tomatoes at home.
This is because at home, you have an elastic need for tomatoes. One week you need a few, the next week you need none, the next week you need a lot. In that case, yes, growing your own tomatoes would be very silly. (This part of the analogy works with on-demand instances.)
However, if you aren't a home, but you're a busy restaurant, you're not buying tomatoes from the grocery store. You have a regular, fairly fixed capacity, and so you go with a produce vendor who's able to serve that need at a decent price. Part of the reason you're able to get a cheaper price is through volume and due to the regular-ness of the business. (this part of the analogy works with reserved instances.)
Okay, so let's move from tomatoes to the actual building of a restaurant itself. Similar to a reserved instance, renting a building is a decent way to get started with less capital, and you have fairly consistent capacity requirements. But at some point, you realize what McDonalds did: owning the building and land beneath it ends up being a great deal at certain scale. Because that ends up being cheaper still, in the long run. This is closer to on-prem. (Okay at this point this analogy is getting pretty silly but it was fun to try and work through it...)
So, the trick is, for a lot of organizations, they could realize the benefits of owning their own hardware, but to get back to your original analogy, running your own hardware comes with its own set of costs that may make it not worth it. You have to have staff to operate everything, you have to manage all of the various supplier relationships, keep track of software licensing fees, etc etc etc. Even with all of this, as my sibling comment shows, often this can be cheaper than using the cloud.
But one way of looking at Oxide is, we are making it so that it's simpler to own your own hardware, thanks to all of the integration work we do. You don't have to manage a ton of vendor relationships, you have "one throat to choke," as they say. You don't have to keep track of software licensing fees, there are none. You don't need to build out your own software to put the whole thing together, we give it to you. Etc.
So yes, just like a household is best served by going to the supermarket, individuals aren't ever going to buy Oxide. But there's a lot more out there than just households. And larger organizations have fundamentally different needs than they do.
> The main reason people think their on-prem is cheaper than cloud is that they are bad at accounting.
I mean, there's also base accounting stuff that differs significantly between the two, like opex vs capex spend. Not that I'm an expert in that, mind you.
jeffbee · 3h ago
My comment wasn't really about Oxide, it's about the fallacy. A person can't succeed in life thinking they can do something cheaper on the sole basis that the other guy makes a profit. The much more likely explanation is that the other guy makes their profit by being much, much better than you.
To stretch the metaphor to a grotesque extent, I think Oxide stands in the middle between the home-grown and the industrial tomato. Your average corporate IT installation has the same economics as home-grown. Even if they have 1000 potted plants, they are still potted plants, and they are still $100 tomatoes. EC2 is a 5000-acre California tomato grower where the fields have been leveled using lasers and the fruits are harvested by robots driving themselves using on-board GPUs. Their tomatoes cost 5¢. An Oxide computer is like having a 1-acre kitchen garden where the tomatoes are in rows. These are more like $1 each. The economics are undoubtedly better.
steveklabnik · 2h ago
> A person can't succeed in life thinking they can do something cheaper on the sole basis that the other guy makes a profit.
That's fair! Just like, pointing out that on-prem can make financial sense.
> To stretch the metaphor to a grotesque extent,
I like it, haha.
master_crab · 6h ago
I don’t disagree that there are some fat margins in the cloud, but how is vendor lock-in any different here? Companies could end up paying fat margins to oxide too while still managing physical gear and plant.
TZubiri · 6h ago
Well, their servers are mostly hypervisors, so the interface is mostly any virtual machine.
You can "just" migrate by exporting or importing the vms.
yencabulator · 2h ago
You're literally ignoring that the Oxide management stack is very much custom and effectively vendor-locking the purchase to be maintained by them. They are not general purpose PC servers.
You can "just" migrate away from Oxide but that would mean throwing away the hardware you now own. That's the grandparent's point; if you're migrating out of a cloud to avoid the margins demanded by the cloud vendor, now you're at the mercy of whatever Oxide thinks your support contract is worth.
Sure, the convenience may be worth it, but watch how many companies are now struggling to get off of VMWare after Broadcom moves.
AndrewKemendo · 6h ago
Having done web applications for oh…30 years now the key pain is network routing
That’s the only thing I can tell is useful about “the cloud”
I can build racks and servers easily, but the challenge is availability and getting past everyone’s firewalls
So the real win is any service that allows for instant DNS table updates and availability of DNS whitelisting.
This is why Google, Msft etc win in email because they have trusted endpoints
Alternative routes with self signed DKIM etc is more or less blocked by default forcing you onto a provider
We need more cloud flare tunnel and local hosting via commercial ISP routes and less new centralized data centers
chrisweekly · 5h ago
+1 Insightful.
I've also been doing web-related work for a living for over 25y and yours is the most spot-on take I've seen in this discussion.
AndrewKemendo · 4h ago
Thank you :)
geodel · 6h ago
Agree. But those fat margins can get starting to be shared with CIOs, CTOs and other managers with purchasing power. IMO the constant hectoring at workplace about migration to cloud or cloud native crap is not coming from some deep technical principles. It is more of Do it before you get fired for non-compliance
turnsout · 6h ago
I've run my own servers for over 20 years now, but I guess I don't understand the pain point. Can you elaborate? They write:
> Our system delivers all the hardware and software you need to run cloud…
To "run cloud?" Does this mean treating your own servers like "serverless?" Does it mean running Kubernetes? Is this primarily for people who want to self-host LLMs?
I'm literally so old that I write programs that run on a server and never think about infrastructure.
steveklabnik · 6h ago
> To "run cloud?"
I agree that's a bit awkwardly phrased, let me send in a patch for that.
> Does this mean treating your own servers like "serverless?" Does it mean running Kubernetes? Is this primarily for people who want to self-host LLMs?
Not exactly any of that. We let you treat an entire rack as a single pool of resources, spinning up virtual machines that our control plane manages for you. Think "VPS provider but you own it." There's an API, but if you want to see what our console looks like, you can poke around with a demo here: https://console-preview.oxide.computer/
turnsout · 5h ago
That's helpful, thanks!
throw0101c · 6h ago
> To "run cloud?" Does this mean treating your own servers like "serverless?" Does it mean running Kubernetes? Is this primarily for people who want to self-host LLMs?
None are generally applicable to standalone pizza boxes as managed individual (as opposed to being herded by (e.g.) OpenStack).
skybrian · 5h ago
No GPU’s yet, so it’s not good for LLM’s. But they have a lot of funding now, so perhaps that will change?
dcminter · 7h ago
Oxide, at least for an outsider, looks like a company that channels some of the spirit of early Sun Microsystems (I'm aware of the connections of course). I'm quite envious of those who work there - I hope the demands of big money don't crush any of that spirit.
Sadly when I look at their jobs posted I don't see much that would line up with my skillset, but I keep an eye on them just on the offchance.
Quarrel · 6h ago
Right?
And such a clear value statement.
If I could, I'd invest. Sure, they might fail, but they're shooting their shot, and to me it has a clear differentiator that would improve the market for most of their users (if not the incumbents).
criddell · 5h ago
I wish there was a way for small investors ($25-50k) to get in. AFAIK, the only thing we can do is wait for an IPO and hope we can get in at a reasonable price.
throw0101c · 6h ago
Meta: Oxide has talked about the designs of their cooling [1][2][3], so I'm curious to know if they ever start offering GPUs how they'd handle that.
Folks seem to be moving toward liquid cooling[4] either to the rack/chassis[5] or even to the chip[6].
Oxide's blogs talk about cooling _a lot_, apparently their stack runs very cool b/c they've reorganized the whole thing around efficiency, and written all the firmware to support that goal.
vonneumannstan · 6h ago
Skeptical of that. There's only so much you can do against the physics of moving electrons around at high speeds... "Bigger Fans" and "compute density" doesn't change that
sunshowers · 5h ago
Commodity hardware doesn't quite tend to operate at a compute vs efficiency Pareto frontier — there's a lot of wasted energy that we've been able to optimize with our vertical integration. (I work at Oxide.)
pmichaud · 5h ago
I don't have any particular knowledge about oxide's cooling, but think about how bloated and inefficient literally every part of the compute stack is from metal to seeing these words on a screen. If you imagine fixing every part of it to be efficient top to bottom, I think you'll agree that we're not even in the same galaxy as the physical limitations of moving electrons around at high speeds.
kortilla · 4h ago
But the majority of heat is going to come from the CPU and this is a product to run arbitrary customer workloads.
If the customers leave these things idle, then oxide is going to shine. But a busy rack is going to be dominated by CPU heat.
throw0101c · 3h ago
According to Oxide Computer, they found that going from 20mm to 80mm fans dropped their chassis power usage (efficiency is to the cube of the radius): a rack full of 1U servers had 25% of its power going to the fans, and they were able to get down to 1.2%:
> Compared to a popular rackmount server vendor, Oxide is able to fill our specialized racks with 32 AMD Milan sleds and highly-available network switches using less than 15kW per rack, doubling the compute density in a typical data center. With just 16 of the alternative 1U servers and equivalent network switches, over 16kW of power is required per rack, leading to only 1,024 CPU cores vs Oxide’s 2,048.
This is not any different than the "blade" form factor that was popular in the 90s. Shared power and cooling that was not constrained by the height of a 1U rack chassis, with larger fans. Hell, even Supermicro has blade-style chassis with 80mm fans. This is not novel.
It's just plain old engineering, optimized to sell whole racks not individual servers or <=8U units, sprinkled with opinions about low-level firmware etc, with a bespoke OS and management stack.
sunshowers · 2h ago
Yes, we're primarily an engineering company, not a research organization.
It's also about what we don't have. We don't have a UEFI, for example, which means we don't have UEFI vulnerabilities.
yencabulator · 1h ago
Yeah and you're doing good work there. It just kinda annoys me when people go from "oh that's a cool company" into idolatry. 1U servers were always a poor form factor for modern day hot chips & drives. Breaking that mold has been done over and over and isn't something that should be treated as new.
Scaling from the 8U (that blades could already do in the 90s) to full rack as the unit of "slide unit in to connect" DC power and networking is way cooler than using 80mm fans.
Re UEFI: I feel like that part is less about UEFI itself and more about how you have very minimal third party firmware.
I'm pretty excited about openSIL and such in general. If only AMD could execute well in the world of software.
sunshowers · 16m ago
I can't speak to others' views, but having worked with large-scale bare-metal deployments at Meta, I personally admired Oxide for its clear product vision and rigorous first-principles approach (Rust is a real game-changer!), and applied to work here for that reason.
throw0101c · 2h ago
> It's just plain old engineering, optimized to sell whole racks not individual servers or <=8U units, sprinkled with opinions about low-level firmware etc, with a bespoke OS and management stack.
Yes, "just".
jiveturkey · 1h ago
An F1 car is also just plain old engineering, optimized to get around the track quickly, sprinkled with opinions and with a niche bespoke drivetrain. Nothing to see here.
zozbot234 · 4h ago
Their rack scale from-scratch redesign includes fans big enough that they've reportedly managed to cool CPU hardware that was actually designed for water-cooling, with no expectation for air cooling (though admittedly, they say they only achieved this just barely, and with a LOT of noise). That seems like something that's going to be objectively verifiable as a step up in efficiency.
capital_guy · 6h ago
I believe the fans are actually smaller. The rack is definitely quieter than other racks, but he says in the rear rack tour that it's quite hot. Check out these videos of it
The fans are 80mm, traditionally 1U is roughly half that size.
naikrovek · 4h ago
maybe you're not familiar with just how stupidly written most code is.
you're right that there are efficiency limits, but not once in my career have I ever seen anyone even attempt to write their code so that it is efficient to run, outside of gaming.
Rendello · 5h ago
If after that you're not satiated with data center cooling talk, Jane Street's Signals and Threads just did an episode about their cooling infrastructure a few days ago:
There is something so calming and pleasant about a well-structured thesis statement:
> Our thesis was that cloud computing was the future of all computing; that running on-premises would remain (or become!) strategically important for many; that the entire stack — hardware and software — needed to be rethought from first principles to serve this market; and that a large, durable, public company could be built by whomever pulled it off.
Very clear and logical, stating from their first principle world view what the result could be if they succeed.
chubot · 6h ago
I would say it's very clear and logical ... but is it really "from first principles"?
I thought that Oxide was based on OpenCompute, which is basically the rack designs that Facebook open sourced, after hiring some Google employees to build their custom data centers. This project started in 2011:
Google definitely rebuilt the stack from first principles -- the data center was basically a huge embedded system, from power to racks to CPUs/memory/disk/network to kernel to user space to cluster software. (And no, they did not use Kubernetes.)
I have no idea how active the OpenCompute project is -- is Facebook still the main contributor, and are they still releasing their new rack designs?
And I also wonder how much Oxide has diverged from it? At least on the hardware side. On the software side, I guess the Illumos-derived parts and Rust parts are completely different.
Well, when they say they did their own:
- board designs
- microcontroller OS
- platform enablement software
- host hypervisor
- switch
- integrated storage service
- control plane
Then yeah it seems like maybe only board designs and the switch COULD have either come from or been influenced by OpenCompute, but maybe those didn't either. (I have no idea tbh)
Maybe they only got the mechanical and power stuff from OpenCompute? i.e. the parts that change more slowly
bcantrill · 5h ago
We didn't use anything from OCP. When we first started the company, we thought we might use the enclosure (and considered ourselves "OCP inspired"), but there ended up being little value in doing so (and there was a clear cost). And on the stuff that we really cared about (e.g., getting rid of the traditional BMC), we were completely at odds with OCP (where ASPEED BMCs abound!).
So in the end, even the mechanical and power didn't come from OCP. We clearly build on other components (we didn't build own rectifiers!), but we absolutely built the machine from first principles.
chubot · 4h ago
Ah OK, thanks for clarifying! I'm glad to see these kinds of machines being built, especially with so much open source software
jeffbee · 3h ago
How does the Oxide 48V architecture compare to what is known about the Google/OCP architecture? Does Oxide use single stage conversion, intermediate 12V buses, or ??
steveklabnik · 2h ago
I'm not someone who works on this part of the product, but we talk a little about this stuff here:
Anyway, I barely know anything about this topic, but I think this answers your immediate question: we convert AC -> DC once at the rack level, and then use a bus bar to distribute that to each sled. Each sled also has a converter to convert that 54V down to 12V for its own bus within each sled.
jeffbee · 1h ago
Probably the sweet spot, since you can get to market fast with known 12V designs, but still enjoy the possibility of later announcing you've made the sled even more efficient by getting rid of the intermediate voltage!
syntheticgate · 7m ago
At a certain point in EE power design you don't really want to go from 54V -> point of load for every rail (1.8V, 1.1V, 0.9V, SVI3 rails etc), so sticking with an intermediate voltage makes sense often even when viewing this from an efficiency perspective. Voltages such as 54V require different creepage and clearance requirements, so saddling every point of load regulator (of which we have many many!) with those requirements is often detrimental to an already complex board layout. Picking something like 12V or 24V as an intermediate voltage helps balance those requirements with the amount of copper you need for power delivery since the parts use low voltages but are extremely power hungry so your current at the point of load rail is a lot. This also means that your point of load regulators have to be distributed around the board near their loads otherwise the copper losses and noise would become problematic.
steveklabnik · 5h ago
We initially talked about OpenCompute, yeah, but as far as I know we ended up moving away from that years ago.
krelian · 5h ago
>public company
Why does it have to be a public company though?
steveklabnik · 5h ago
It is either that or acquisition, and we would prefer an IPO.
GoatInGrey · 4h ago
Speaking from the experience of 8 acquisitions/IPOs, your compensation structure will not survive public ownership. It could survive a PE acquisition, but definitely not public ownership (in my experience). I would recommend petitioning for a dual-class share structure to protect founding leadership.
steveklabnik · 4h ago
We agree that we don't know what the future holds, and what makes sense for early stage companies may not make sense for later ones. When anything stops working, we'll make changes. You can see this already with the secondary structure for sales. We have a while before we need to worry about that, though :)
bcantrill · 5h ago
Because VCs need to have a way to sell their shares within the (limited) lifetime of their fund.
ang_cire · 5h ago
Good for them! I used to walk my dog past their (office? warehouse?) in Emeryville, and when the weather was warm they'd have the doors open and the giant server stacks just sitting there, looking awesome. I guess it's not really a concern that someone will steal something that looks like it'd take a forklift to move.
The ultimate aspirational homelab setup, ngl.
stego-tech · 5h ago
Congrats to Oxide on this milestone! I’ve been following their progress since discovering them in COVID, and would love to see them shake up what’s presently a stagnant marketplace with their product line. The idea of deploying a rack of kit on-prem that’s tightly integrated instead of wrangling multiple vendors of discrete components has a strong appeal, and while the proprietary hardware stuff did initially give me pause, their commitment to building atop Open Source quelled any lingering doubts I had.
Would love to see their growth result in more versatile options, like quarter-rack or industrial deployments someday. In the meantime, congrats on the successful fundraising!
piker · 5h ago
Aside from the actual product, On the Metal / Oxide and Friends are really great podcasts that manage to make programming topics entertaining and educational. Bryan Cantrill is wildly entertaining and knowledgeable at the same time. His co-hosts and guests are great, too, and I attribute a lot of that to feeding off of his energy and storytelling. Highly recommend, especially for Rust folks.
Rafuino · 7h ago
Great news for Oxide. I followed their podcasts for a while but they petered out and I haven't heard much about their products/growth for a while. Sounds like it's still viable.
USIT... what a cryptic website! Is it government-related (like In-Q-Tel) or private? Have no idea...
Just because it's hopelessly on-brand for us to offer up a podcast episode for everything, you may also be interested in our Oxide and Friends episode on RFDs with our colleagues Robert Mustacchi, David Crespo, Ben Leonard, and Augustus Mayo.[0]
I need to dive back in. Lots of distractions recently.
KetoMojito · 7h ago
Bryan you absolute legend. You give the best technical seminars i've ever watched (& countlessly rewatched). Ty for inspiring a generation of engineers. Best of luck with everything at Oxide!
cosmic_quanta · 7h ago
I love the idea. RFD 1 mentions taking inspiration from Golang and Rust proposal processes. The Haskell Foundation also uses the same proposal process, and I love it.
I'm a big proponent of the "writing is thinking" mantra. Unfortunately, in my experience, not all technical leaders value grassroots proposal processes like the Oxide RFDs
bflesch · 3h ago
the rfd interface looks really nice. I couldn't find the github repo for it, is it proprietary?
I am wondering what they have on Roadmap and if Zen 6 will come. Their AMD EPYC™ 7713P is 4+ years old already. Or is Hardware performance not a main focus for Oxide but Software that came with it?
In 2027 - 2030, We will have 256 Core Zen 7 CPU with PCIe 6.0 or 7.0 SSD and Network. If Liquid Cooling ever come to Oxide we are looking at 5 - 10x the compute power of its current hardware.
Somewhere along the line a Single Oxide Rack would offer enough Compute and Storage for 95% of customers. And whenever I think about having Solaris in every rack just put a smile on my face.
jeron · 3m ago
at any rate, I'm looking forward to decommissioned Oxide racks making it into my homelab for pennies on the dollar
steveklabnik · 3h ago
> Or is Hardware performance not a main focus for Oxide but Software that came with it?
It's more of that we're a young company, so we can only do so much, so quickly. Plus, because we do so much custom work, that all takes time. As we grow and scale up, we'll be able to move forward more quickly on updates on the hardware front.
wmf · 3h ago
They've been working on Zen 5 Turin for a while so hopefully soon they'll only be 1 year behind.
mystraline · 6h ago
I applied here. Basically anti-llm long form one-sided interview writeup.
Took them 3 months before a "we're not interested" email was sent. No reasons, either.
I probably should have just used an LLM to generate good sounding garbage. Probably the same chance to get even a stage 1 interview.
steveklabnik · 5h ago
We do take a long time due to needing to read all of those applications, but three months is longer than we'd like, so I apologize about that.
We don't do "stage 1 interviews", we only do interviews as the very final step in the process, when we've narrowed things down to a handful of people. That initial packet is like 85% of the process.
kierangill · 5h ago
I applied in early 2021. Getting rejected from any company carries a sting, but I was grateful to have gone through the process.
I didn’t realize at the time, but Oxide’s application process was the best form of interview prep I’ve done. The process forced me to thoroughly document my values and career accomplishments. In later non-Oxide interviews, I effectively recited what I had written my materials. In that way, it has felt less one-sided than every other company application process I’ve gone through. I was able to take away an artifact from the experience, versus being filtered out via a coding challenge. It’s also been rewarding to reflect on my submission from years ago to see how my mindset and skills have evolved.
If you have any interest in working in the pediatric telemedicine space, I encourage you to email me your application. We accept Oxide materials. I’m happy to provide feedback as a hiring manager. My email and our company website are in my bio.
sudomateo · 4h ago
Loved reading your experience here. Thank you for posting it. I've written about the value of an artifact in the past when people pushed back against the Oxide materials saying they are a lot of work for no guarantee. When I first applied to Oxide I was also rejected and the materials process taught me a ton about myself and changed the way I viewed job searching and my work. I shifted course and increased my skills and next time I applied I got an offer. There's power in the critical thinking and writing the materials force out of us.
mystraline · 1m ago
> they are a lot of work for no guarantee.
Well, its the assymetry of wanting a 10 year CV with various orthogonal points in your career.
Unlike an actual interview, which is equal time investment, this 20 page paper gets the commentary and result of "no". "No" what? You can ask an interviewer about concerns, and discussion points. This email from no-mail@ is just nothing.
And its not the sting of rejection. I've been turned down, and I too have turned down. But its the mechanistic, dispassionate, legalistic response after months of a "No". And not even a 'What we're looking for is.... '
MerrimanInd · 3h ago
That's very interesting because in their episode on hiring practices they said that they hoped the materials would be a valuable exercise for anyone deeply engaged in a job search. Hearing that same feedback from the other side of the process really closes that feedback loop!
MOARDONGZPLZ · 7h ago
Very bullish on this team! Congrats. I’ve been pushing my company to adopt their hardware, and we have!
cosmic_quanta · 7h ago
How do you like using their stuff? I would be interested in reading an experience report
htrp · 7h ago
Same! also curious about how you think about the potential of vendor lock-in?
steveklabnik · 2h ago
(Not your parent) What kind of lock in are you worried about?
kamranjon · 7h ago
Anyone here using oxide hardware? I remember reading their blog post when they were spinning up and it seems like they have actual products now.
(random superficial comment: the ascii art + high fidelity ui combination on the oxide landing page is chef's kiss)
nahimn · 7h ago
Rooting for this team -- just wish i could afford one of these racks... =)
dijit · 7h ago
Same.
I think it brings an interesting point actually.
"Who will buy these", the obvious answer is anyone with a need, but the "standard pizzabox" server is ubiquitous for the same reason that x86 and miniPC's outcompeted mainframes.
((controversial take warning))
Mainframes are objectively better at high uptime and high throughput than rube-golderging a bunch of semi-reliable x86 boxes together, yet, the ubiquity of cheap x86 hardware meant that the lions share of development happened on them.
People could throw a pentium 2 PC in a corner and have it serving web traffic, and when things started growing too much you could add more P2 machines or even grab a Xeon 4socket machine later down the line.
This isn't possible with mainframes, and thus, people largely don't mess with them.
The annoying thing is that this kind of problem has some kind of stickiness effect. If you need a server, and then another, you buy them as you need them and if you're already 20 pizza boxes in; it's a pretty big ask to rip them all out and moving to a different vendor entirely than staging replacements one after another.
So I guess their target audience is the "we don't want to touch cloud" organisations that have a good IT spend that are willing to change vendors?
I don't think I've worked for any of those.
(FD: I'm actually a fan of the Oxide team, and the concept, and I would buy into the ecosystem except I have needs that are at most 3 servers at a time)
ipdashc · 6h ago
A great point regarding mainframes, but isn't it somewhat irrelevant given that Oxide's computer is x86 and mainly (...only?) intended as a VM host? And I assume most people are running things in VMs nowadays, so you can "just" migrate over images to the new system (I know it's not that simple, but it's also not quite as complicated as, I imagine, porting something from a bunch of bare-metal x86 boxen to a mainframe).
Also, I'm given the impression that Oxide prioritizes user experience - their website shows off a clean UI and they presumably have modern, easy-to-use APIs. Mainframes, in contrast, seem like a whole different world - if I convinced my company to move to a mainframe, who would even operate it? I know modern mainframes are closer to "normal" servers than their old reputation, but still, I'd imagine it's pretty esoteric stuff, and IBM is famous for not being the cheapest to work with.
I do find it pretty funny that their business model seems to be reinventing mainframes, but I feel like there are important distinctions too. Hopefully they do well (I'd also love to have access to this stuff, but yeah, same "needs that are at most 3 servers" deal).
zozbot234 · 4h ago
Mainframes are the original VM host. Oxide racks seem closer to midrange computers from a RAS (Reliability, Availability, Servicing) perspective, but that's pretty much to be expected to begin with. They also have a lot of scope for improvement and are kind of a natural candidate for eventually intruding on that market.
cdaringe · 6h ago
Not very controversial, tbh. Your observation is essentially that there is momentum on a current platform, which yields availability, pricing, and general convenience benefit. It’s borderline indisputable!
The market is complex. Those who will buy will be those who find that the existing ying doesn’t snap perfectly into their own business’ yang. They’ll be at the margins first (the post references a lab for instance, not a booming tech company), then over time less so.
supriyo-biswas · 7h ago
> So I guess their target audience is the "we don't want to touch cloud" organisations that have a good IT spend that are willing to change vendors?
Companies do modernization/migration projects from time to time; I guess one way to solve the audience issue is to find companies that have such a planned event and try to market a “better” alternative.
While I’m also a fan of Oxide; my primary concern is whether they can actually get companies to ignore the marketing that comes out of cloud services.
bpt3 · 5h ago
The target audience as I understand it is companies that have gone cloud-only or close to it and are big enough where moving workload on-prem makes financial sense.
They can migrate to an Oxide "cloud" without too much difficultly as opposed to procuring, installing, and maintaining the rube goldberg machine you mentioned.
They also attract interest among the "we don't want to touch cloud" organizations where trying out $1M in hardware is a rounding error, but I don't know how much traction they'd end up getting.
actionfromafar · 6h ago
I guess if you have big pile of pizza boxes, buying an Oxide could feel like buying Oxide Family Pizza and going from there. Maybe you don't migrate everything at once.
tryauuum · 6h ago
governments maybe?
macgillicu · 1h ago
This is great. I hope they stay committed to the open source side of things, but all evidence seems to suggest they're serious about it. Generally, it's great to see a good idea getting executed well and arguably improving the state of affairs in computing, and making it, as it were.
The flat salary structure at a generous level (from my perspective, anyway) is a breath of fresh air. Everyone getting caught up on the equity is a bit hard to understand, given the clarity of the message from the company.
I will be applying for one of the open positions. Kudos to this company for their approach to business, and congrats on the success.
pjmlp · 7h ago
Congratulations on the achievement.
It is always a pleasure to follow up with Oxide on their podcast, their technological decision to keep the Solaris linage alive, all the places across the infrastructure they have been using Go and Rust as well.
bix6 · 6h ago
What is the initial cost to setup their smallest system on prem?
diggan · 6h ago
Not finding a ton of information about it, was curious about it too. But the "smallest system" seems huge, like 16 sleds and a HN comment from 2023 (https://news.ycombinator.com/item?id=38498840) says:
> An oxide rack has a minimum cost of something like 600k not including all the infra you need to run a rack, maintenance, and then needing to upgrade
So maybe not super useful for people who are looking to do some home-lab stuff or even setups for SMBs.
> My guess is that a base config would be somewhere between $400K to $500K but could very definitely go up from there for a completely "loaded" config.
It's much broader than that, but you're right that we make sense for larger organizations, not smaller ones.
sailfast · 3h ago
Government.
vhodges · 6h ago
If you have to ask.... :)
(other people's) previous guesstimates were 500k - 1M. It does look like you can order it partially provisioned (compute wise I'm guessing) and expand later.
mijoharas · 6h ago
I googled this out of curiousity a little while ago, it seemed to be 600k or so. (possibly dubious source so ymmv) [0]
I can tell Bryan wrote this by the vocabulary... Congrats on the traction - haven't had a use case for rack-scale infra yet but hopefully soon!
fsckboy · 4h ago
>Our thesis was that cloud computing was the future of all computing
just want to give a shout out to my old boss from the mid 80's who had researched it (mgt consultant) and told me at that time that cloud computing was the future of all computing because the economics were inescapable.
RIP.
toomuchtodo · 7h ago
Big congrats to the Oxide team.
azemetre · 5h ago
Always happy to see Oxide Computer succeeding. As others have mention their podcast is truly great and their productive is quite innovative in the space.
With this news I hope they plan on expanding hiring for frontend devs soon, would love to work with such leadership once in my life.
derangedHorse · 3h ago
After scrolling the site for 5 minutes, I still don't understand what they do. Do they offer on-prem servers? Then how does it bring cloud scalability? Is their selling point modular computer components so that you can order things online to achieve cloud scalability? Whatever it is, I expect it to have a poor user experience if I can't find a simple 'about' page.
steveklabnik · 2h ago
> Do they offer on-prem servers?
Yes.
> Then how does it bring cloud scalability?
You buy an entire (or half) rack at a time, and then can treat the entire thing as one elastic pool of resources, you do not need to manage the individual sleds within the server yourself. Your interface to the rack is similar to a VPS provider, it's "give me a new vm with these specs."
Happy to elaborate if you have more questions.
mkoubaa · 17m ago
In the end, the mainframe wins
LeoPanthera · 4h ago
I know that this isn't their mission so I'm not really complaining, but man, if they ever start to offer smaller homelab-scale stuff, they can have all my money.
doctorpangloss · 4h ago
One POV is their model doesn’t work for small purchases period. It’s not so much a hardware or software vendor so much as an IT agency. Which can be good venture businesses! Of course, everyone looking at this problem thinks, to make a small cost offering: that’s what a cloud is. Oxide’s problem statement says something like AWS doesn’t “make sense.” It makes way more sense than Oxide. The problem with AWS isn’t that it is bad, it’s that Amazon is greedy.
sailfast · 3h ago
Is this a government run VC firm? Next gen In-Q-Tel? Makes sense for highly classified workloads on-prem and there’s a lot of demand for that.
Could be a need for unclassified workloads also… but curious if this is a defense and Intel community venture fund backing this next round with my tax dollars.
tgtweak · 3h ago
Likely government-adjacent and with high portfolio use case match. These orgs are less and less keen on shifting sensitive workloads to public clouds - even "gov clouds". Let's not forget that the best access control is to have no access, and that obscurity is actually a form of security especially in a world where effort put on vulnerability searching is proportionate to popularity. The odds of someone discovering and exploiting your obscurely coded and privately hosted oxide stack are orders of magnitude smaller than someone compromising your public cloud.
USIT >
U.S. Innovative Technology (“USIT”) is an investment firm that backs growth-stage commercial companies with critical technologies relevant to the national interest, including, artificial intelligence, future of compute, new industry, space & communications, bio & healthcare, and defense tech. USIT was founded by American technologist and visionary investor Thomas Tull.
joined by: Riot Ventures, Eclipse, Jane Street
jppope · 7h ago
Love what they are putting out in the world! Congrats on the round, and being able to proliferate the work!
EcommerceFlow · 7h ago
Isn't it sad we're not able to invest into most new tech companies these days, with private equity taking the lead. I don't blame the companies after seeing what going public entails, but still unfortunate.
maerF0x0 · 6h ago
some aspect of that picture are nanny-state sorts of laws like Accreditation which have a bias that says if you're "poor" then you're not intelligent enough or qualified enough to make your own best choices of investment.
I was happy to learn about Sweater Ventures https://www.sweaterventures.com/our-story (and their kind) which are opening up access to investments, and also helping ensure the entry price is quite low (for example I invest $50 a month with them) .
It is my hope that in the future you will be able to order a micro fraction of any company as easily as you could a starbucks.
And IMO part of that equation might be to have the state start to work against contracts which restrict your rights on your own property (essentially contracts restrict when you can sell your shares, usually not until IPO or a company organized liquidity event)
brianzelip · 5h ago
Love the blog post with a one-off art direction!
Also love the Oxide and Friends podcast! What strikes me most lately about Oxide since falling into their hefty episode backlog, is their book club culture. I really appreciate the ability to get a fly on the wall experience of it, I learn a lot!
I predict that if they take this same philosophy and use this money to add some new pieces on top where those new pieces are 'open' in the same way as their current hardware stack but which allows them to also run 'gpu bound' workloads well -- then I suspect they will make a ton of money.
kayson · 7h ago
What do they need so much capital for?
simonw · 7h ago
My guess is scaling up their ability to manufacture hardware.
dcminter · 7h ago
I think the downvoting on you is a little harsh. TFA does allude to it, but doesn't explicitly answer your question. I presume the implicit answer is here:
> With growing customer enthusiasm, we were increasingly getting questions about what it would look like to buy a large number of Oxide racks. Could we manufacture them? Could we support them? Could we make them easy to operate together?
i.e. they need the capital in order to be able to satisfy large orders on sane timeframes - but that's very expensive when you're a hardware business.
kayson · 6h ago
Thanks. It was a genuine question but I guess I can see how it might be taken otherwise.
devmor · 6h ago
They are a hardware company. Hardware costs a lot of money to innovate and build on.
skeptrune · 6h ago
Huge congrats to everyone at oxide! I could not be happier to see such a cool company trying to create a real alternative to renting from the hyperscalers.
anomaloustho · 4h ago
If I was interested in getting started with Oxide, could I even do so? It seems like this is only tailored to large enterprise sales. The only other option is just using them as your AWS replacement.
steveklabnik · 4h ago
> If I was interested in getting started with Oxide, could I even do so?
> It seems like this is only tailored to large enterprise sales.
Since we sell half or full racks at a time, it's true that we're geared towards larger companies, as small shops just don't need that much computer.
> The only other option is just using them as your AWS replacement.
That's the use case, yep!
esafak · 6h ago
I see no mention of GPUs in their platform?
yencabulator · 2h ago
My personal predictions:
#1: Don't expect to see it until after AMD or someone else makes a product that actually manages to compete against Nvidia. Nvidia is pretty hostile to not running their low-level software stack, and Oxide is all about the legacy of Solaris.
#2: AMD MI400 or relative will be an extra chipset on future server motherboards (not a separate PCI card). Simultaneously, the boundary between "CPU vector processing" and "GPU used for transformers" will blur, and the chipsets will slowly merge into chiplets in one package.
#3: AMD MI400 and such AI accelerators will be primarily sold as full racks with its own custom "networking" (UALink switch), and the actual host CPU on those devices will be lower specs and mostly relegated to setup and metrics of the AI work, much like storage and networking appliances are built, AI workload will not even pass through the host CPU.
I'm not sure Oxide can compete in that world. The "business logic CPUs" will reside in a different rack.
If only they bring back their "On the metal" podcast. That podcast scratched an itch I didnt knew I had .
bcantrill · 3h ago
Check out Oxide and Friends[0]! We've been doing it for several years now, and it's a much more flexible format that allows the team to be heard in its own voice -- and allows us to weigh in on whatever's on our collective mind.
God why do startup sites suck so much?
Why do I need ChatGPT to cut through the marketing speak to understand what they are actually selling?
I literally spent 5 minutes in the site trying to understand before giving up and asking GPT...
Cool 1999 aesthetics though
diggan · 6h ago
Maybe I'm old-school, but I clicked on the logo in the top left, then read the first sentence which reads "On-demand elastic resources", which gives me some idea about what it is, and then later it says "A rack-scale system, built true to cloud architecture, that you can own and operate in your data center." which makes me 100% understand what the product is.
Do new internet users not know that the landing page usually contains information about the product they're talking about in their blog posts? 99% of the cases you can find what you're looking for on the landing page, and it took me a whole of 30 seconds to get here, writing this comment took longer time.
sofixa · 6h ago
> On-demand elastic resources
Which is kind of wrong, because there is nothing elastic nor "on demand" about metal you buy.
diggan · 6h ago
The hardware isn't elastic, obviously. But if a IT department sets up a Oxide rack, then the software development department can get the same sort of "on-demand 'elastic' resources" provisioned in that rack. I think that's what they're getting at. But yeah, obviously hardware itself can't be on-demand.
ironhaven · 4h ago
Elastic as in AWS Elastic Compute Cloud (ec2). Flexible virtual machines provisioned with a web API not rubbery stretchy servers
sofixa · 20m ago
By that metric even VMware's vSphere with its abominable excuses for APIs also count as elastic.
If you have to manage the hardware yourself, have to plan and pay for upfront for the maximum capacity you would need, and there are fixed limits you can hit and have to plan around yourself, it's not elastic.
qualeed · 6h ago
They explain what they do pretty much immediately on the home page, I'm not too sure where the confusion comes from.
subarctic · 4h ago
They make giant rack scale computers for data centers, i think that's the best way to explain it quickly to someone with my background who's never been in a data center but has an imaginary idea of what they look like.
And then as a follow up you have to explain that
- they sell an entire rack full of servers
- they're the only ones that do this. Normally you have to buy all the pieces and put it together yourself, or pay someone to put it together for you but all the parts are kind of designed on their own by different companies so it's kind of a mess. Oxide makes one big rack with like 16-32 servers and it's all designed by them and just works, so you just plug it in and you have servers you can put a bunch of vms on. Oh and they're huge, each one literally costs like a million dollars
voganmother42 · 5h ago
The usage/meaning of “private cloud” has gotten weird
mlnj · 6h ago
Reading the first 20 lines of text that they have broken down in to:
Company Name
Single line Headline
Problem
Our Solution
Gives you the entire company premise and product description.
devmor · 6h ago
If you scroll past the marketing blurb, I think the rest of the main page explains in pretty clear and simple terms what their product is. What did you find confusing about it?
actionfromafar · 6h ago
Frontpage: "A rack-scale system, built true to cloud architecture, that you can own and operate in your data center."
Seems pretty clear to me.
yankcrime · 6h ago
Congrats to the Oxide folks, like a lot of others I'm rooting for you.
sneak · 7h ago
Always refreshing to see people who actually believe in software freedoms (and not just doing open source cosplay like many big corporations) forge a pathway to big success.
There are many things that suggest free software and the movement for software freedoms might be on its way to a historical footnote. This is absolutely not one of them.
Hey Bryan, one day when you’re very successful market-wise (you and your team have already obviously been massively successful from an engineering standpoint) and aren’t in crash-priority-override mode to get cash flow, please consider a project to build SME stuff that reaps the security and integration benefits of your big enterprise stuff that is affordable for end users like entrepreneurs and home hobbyists, like Ubiqiti does. I’d love a lil’ $5-10k homelab unit, and I bet a number of smaller universities and organizations would go for stuff in the low 5 figure 2-3kW range. Obviously your bread and butter comes from companies that size their orders by number of racks, but if you never go downmarket then thousands of us hackers that love what you’re doing will never get to touch Oxide stuff except at a job in a megacorp.
cestith · 4h ago
It would be a good onramp into their ecosystem. Compare this to the deep educational discounts and the school-targeted platforms from Microsoft, Google, Apple, and such.
immibis · 7h ago
The term "open source" was created by corporations in opposition to "free software", as a watered-down version of the latter. Open source itself is already free software cosplay.
ryao · 7h ago
Congratulations everyone at Oxide!
whalesalad · 6h ago
I would really love to run their control plane in my homelab.
mkeeter · 6h ago
I'm not aware of folks outside the company running the whole control plane, but people have definitely gotten parts of the system running at home:
(The author of this blog post now works for Oxide!)
jefurii · 4h ago
How much of the software stack is even possible to run without the specialized hardware? I'd also really like to try that control plane..
lawik · 5h ago
I love following their adventures. Glad to see that it continues.
jiveturkey · 1h ago
> We did our own host hypervisor, assuring an integrated and seamless user experience — and eliminating the need for a third-party hypervisor and its concomitant rapacious software licensing.
In exchange for your own hardware purchase cost, in practical terms also a license.
> We did our own integrated storage service, allowing the rack-scale system to have reliable, available, durable, elastic instance storage without necessitating a dependency on a third party.
In exchange for an unbreakable dependency on the first-party solution.
I'm being overly aggressive because I do lurve your product and the Sun/Apple way of vertical integration is especially valuable for security ... things break at the interfaces and since you have absolute control over that, you can be actually good. Then there's the improved UX that comes with an integrated product. The root of trust work you've done is especially noteworthy, in a sea of also especially noteworthy efforts across the entire vertical product.
But I'm leery that with the absolute lock-in, and VC pressure, you might succumb to squeezing your customers a la AVGO.
renewiltord · 5h ago
They're a cool team and I like the idea so I hope it works. In our case, for the few million, we could get a hell of a lot more hardware (Epyc 9654 based machines to start with - much better operating cost / compute) so the magic must be in the software.
steveklabnik · 3h ago
It is true that because we're a young company, we currently have the initial SKU that we started selling two years ago. Like every hardware company, we'll be releasing new products with new hardware every so often. Totally hear you if the current product doesn't fit your needs though, that's just going to be the case when we're so young, but as we grow and scale, we'll be able to release more variations that could make sense for more people.
renewiltord · 25m ago
Good luck! Eager to see your later SKUs.
9cb14c1ec0 · 4h ago
There is so much more than just slapping servers in racks when you reach the hundreds of thousands or millions in server hardware. Good control plane software makes a night and day difference.
renewiltord · 28m ago
Admittedly this would have been an exotic for the Bay Area but mundane for elsewhere use-case since we just needed really fast disk and fast compute because we just ran model tuning and backtesting on the machines. 90% utilization, 100G network, 4xNVMe. We only had an 8-member team so much of the management/IT-layer replacement stuff that Oxide enables wouldn't have been as high leverage across the tens of thousands of cores. We almost certainly left a lot of stuff on the table, though.
Also, is your username something interesting? It feels familiar but a quick `echo -n '' | md5sum` didn't yield anything.
oldpersonintx2 · 7h ago
great people and vision, but the hardware market went apoplectic for GPUs at scale just as they were pushing a better way to manage VMs
in the midst of everyone making a land grab for GB200s, does anyone have time to evaluate their alternative OS?
louwrentius · 5h ago
They got $100M from USIT, which seems to be owned by Thomas Tull
Amazing, considering they don't seem to have GPU offerings.
cpach · 6h ago
There are very many workloads that do not benefit from a GPU.
colesantiago · 7h ago
Lots of praise not much skepticism, so what is the exit here?
$100M is a lot of money investors want to see returned of the total amount raised of almost $200M?
Remember Oxide is VC backed so there must be some strings attached here, is it an IPO or an acquisition for an exit or just staying private?
simonw · 6h ago
From the article:
"Our thesis is [...] and that a large, durable, public company could be built by whomever pulled it off."
So the goal is an IPO.
heeton · 6h ago
I'd assume eventual IPO. And/or specific lucrative contracts within US Govt/Military/Tech.
cpach · 7h ago
AFAIK staying private is nearly impossible after taking VC funding…?
Also, what they do is very capital-intensive, so I’m not surprised that they’re raising more money.
2OEH8eoCRo0 · 7h ago
I don't get it. They're a hardware integrator with a secret sauce management layer on top. I like anything on-prem but this seems a bit hyped. Slick website and appears to have a very good team though.
mkeeter · 5h ago
The server and switch hardware is designed in-house (from the PCBs on up), though we do source DRAM / SSDs / CPUs / ASICs from the usual vendors.
Do hardware integrators usually build their own BMC, their own power supply, their own backplane, their own firmware, their own motherboards, their own switches, their own SDN, their own hypervisor, their own OS, their own rack design, their own blade / sled design, their own management API, and build it all in coordination with each other to produce a comprehensively new computing platform?
In my mind they’re much more like an SGI, Sun, IBM, DEC, or Apple type of play than merely an integrator.
cpach · 6h ago
These days there are very few companies innovating in this space. Oxide is the only one I can think of. (No, HPE and Dell doesn’t count, not in my book at least.)
There used to be lots of them, but they all had a very rough time after the 90s when cheap x86 boxes started to become ubiquitous.
I have no idea if Oxide will succeed or not, but I sure hope so. If it goes well they might become the Sun of the 20s.
dvtkrlbs · 5h ago
They created a lot of hardware and low level work. (The bullet point on the blog post)
bananapub · 3h ago
what a weird take.
they produce a private cloud in the form of racks you can buy then just plug in to power and ethernet and run. also, they did a bunch of work so the OOB management isn't fucking terrible, and it uses way less power per FLOP because they bothered to, for example, "make the fans work properly".
Dell will sell you a thousand servers you can then buy racks for, then rack yourself, then buy switches from Aruba, then plug all the switches in to all the computers, then pay VMWare for an vm-cluster-OS, then you can install that, then when something goes wrong you get to call up Dell, Aruba and VMWare and have them all tell you it's someone else's fault.
you...don't get the difference between these two situations?
7e · 5h ago
Investors are likely betting there is an AI play buried deeply in here somewhere.
The founders are uber geeks but have never done anything successful on their own. I predict this company will be another zombie.
checker659 · 5h ago
I predict not. There.
revskill · 5h ago
I don't understand what this is after reading the homepage.
steveklabnik · 4h ago
You buy a rack of servers from us. You wheel it into a data center, plug in power and internet, turn it on. You now have a cloud in a box that you can spin up virtual machines in.
That's the high level, happy to elaborate if you have more questions.
cestith · 4h ago
A few years ago The Register described it as a rack-sized blade chassis with hardware, firmware, and software designed in-house together.
It’s a 7-foot tall rack with compute sleds, storage sleds, and network sleds. It has its own BMC design, its own power design, its own physical connectivity design, its own virtual networking design, its own hypervisor (although it’s based on Bhyve), its own OS (although it’s based on Illumos), and its own API to spin things up and configure them.
As I think of it, it’s basically a private cloud in a box and The Register wasn’t far off.
kortilla · 4h ago
Oxide is a fully closed ecosystem. The product seems cool but it sucks from an open computing perspective.
The “iPhone” of the data center.
steveklabnik · 3h ago
What would you like to see open that isn't? The major thing I can think of is not opening up like, our CAD files for the hardware. But that's pretty far away from your characterization.
wmf · 2h ago
It's open source (that effectively requires the rack as a dongle) but not flexible or modular in any way. There's not even a single PCIe slot AFAIK.
steveklabnik · 2h ago
I see. I wouldn't describe that as "fully closed" but I appreciate the perspective!
setheron · 7h ago
Isn't Oxide kind of like Oracle now building polished vertically integrated monster machines ?
A bit humorous from that perspective given Cantrills dislike for Larry
Nevertheless cool company and product.
throw0101c · 7h ago
> Isn't Oxide kind of like Oracle now building polished vertically integrated monster machines ?
Oxide is kind of like Sun Microsystems, building polished vertically integrated monster machines, e.g. Sun E10k.
Isn’t the main issue with Oracle the aggressive sales and exploitation of captive customers?
Sparkle-san · 7h ago
They don't call oracle "a law firm with a software division" for no reason.
calvinmorrison · 7h ago
I'd assume oracles main issue is that personal-computers-on-steroids as servers mostly won, and we don't all need AS/400 or mainframe architectures. 99% of problems can be solved with practically commodity hardware and software.
immibis · 7h ago
Competing with someone you don't like who has a monopoly on something makes a lot of sense.
cpach · 7h ago
To me they are much more similar to Sun than Oracle (before the latter aquired the former).
guywithahat · 6h ago
The company leadership of oxide concerns me. My biggest mistakes in my (not successful) startup were when I got distracted and chased politics or some corporate goal instead of solving my customers real problems. Giving all employees the same pay or advertising social media links to small, political sites makes me worried they've taken the 100 million and are about to crowd the market with a product that's not focused on solving customer problems
cdaringe · 6h ago
What observations have you made that they are not or would not be focused on solving customer problems?
guywithahat · 4h ago
That they're instead focused on standardizing employee salary, or promoting their company through niche political websites.
These are decisions that the CEO is making, which means they're distracted. This is fine when you've received nearly 200 million in total funding, but won't work once you're expected to add the same level of value while being profitable.
steveklabnik · 3h ago
> promoting their company through niche political websites.
Just to be clear, you mean that we have a BlueSky account, in addition to X? I struggle to think of what you mean.
Generally speaking, advertising on a wide array of platforms is considered a good thing, as you reach different audiences.
guywithahat · 2h ago
Only your bluesky is listed on your website, which is what people see when they go to your site.
This feels the same as past startups where I thought I hit a pmf because of how excited "potential" customers got when I mentioned politics. We built out "political" features, came back, and none of them converted but the excitement grew stronger. Politics is a trap because it adds no value, drives away potential real customer bases, but you will get enormous positive reinforcement because people are excited you're pushing their brand of politics. In my mind, there's a risk you start creating teams to manage "corporate culture" and brand outreach, and if politics sneaks into management they'll actively steer the company in the wrong direction.
Also I'm sorry, if you're actually an executive at oxide I don't mean to be harsh, I thought I was speaking into the void. I've witnessed this destroy companies I've worked on and been involved with, and doing something like only listing a bluesky account is exactly the kind of thing that's a distraction which costs potential real customers.
steveklabnik · 2h ago
I am not an executive, I just work here.
I agree that it's difficult to balance features customers say they want vs the ones they'll actually convert over in an early stage company.
I just don't think "has a BlueSky" means that that is what happens.
sunshowers · 5h ago
A consequence of us all making the same amount of money is that we don't waste time on performance reviews!
jhickok · 5h ago
Huh, what I read and hear leads me to believe that they will succeed because of their leadership.
cestith · 4h ago
Does it follow that because you lost focus that someone else will?
guywithahat · 4h ago
In theory yes, but in practice only so many companies receive nearly 200 million in funding, and they'll be able to buy out competitors and consolidate the market for years to come. Oxide will likely be with us for a while, and in 5-10 years I wouldn't be surprised if people start to hate them while their exec team hangs out with Tom Brady
I think for the internet to break out of walled gardens, high-quality independent datacenters need to exist -- nobody wants to manage their own datacenters, and nobody wants to rely on Google/Amazon/Microsoft's platforms or (even worse) business products. I hope this continues.
https://www.goldmansachs.com/insights/articles/cloud-revenue...
uptime institute publishes some good numbers from survey, which puts on prem + colo still at >50% last I checked.
And still some additional 5% in like... on prem in closets.
Last year Amazon said it was 85% on prem. I dunno who has the right numbers.
Look at who oxide is selling to and for what reasons.
It's about compute + software at rack scales. It does not matter if it is good it matters that it's integrated. Gear at this level is getting sold with a service contract and "good" means you dont have to field as many calls (keeping the margins up).
> Everything we hear about Oxide sounds like an impressive green field implementation of a data center, but is that enough?
Look at their CPU density and do the math on power. It's fairly low density. Look at the interconnects (100gb per system). Also fairly conservative. It's the perfect product to replace hardware that is aging out, as you wont have to re-plumb for more power/bandwidth, and you still get a massive upgrade.
> Look at their CPU density and do the math on power. It's fairly low density. Look at the interconnects (100gb per system). Also fairly conservative. It's the perfect product to replace hardware that is aging out, as you wont have to re-plumb for more power/bandwidth, and you still get a massive upgrade.
It sounds like the CPU density and network bandwidth are not great. If it's only suitable to replace aging systems, does that not limit their TAM? Or is that going to be their beachhead for grabbing further market share.
Given how small we are, new designs and refreshes take a while. Part of growing as a company is being able to do this more often. We'll get there :)
Our stack is open source.
> what difference does it make if its on-prem or offsite?
The difference is not where it runs, it's that you own our racks, rather than rent them. In the traditional cloud, you're renting. Other vendors who sell you hardware will still have you paying software licensing fees, so it never feels like you truly own it. We don't have any licensing fees.
Focusing on just this financial narrative you're weaving, what stops a bank from selling "virtual racks" that work financially the same as owning an Oxide rack, but it's just AWS?
$1m buys you 42U of, whatever. You're handed an AWS account you do not pay for, but it has the $1m worth of, whatever in it, in perpetuity. Maybe the bank even throws in some fakey market you can "part out" and "sell" your rack to, years later, at some "market price."
It seems like, the product - and maybe the experience of buying the product - is what is most important to Oxide. It's really interesting to me, because I cannot wrap my head around what this narrative is:
You guys are Apple of Racks. But minus the iPhone, because there is no monopoly here. So, Apple (Minus iPhone) of Racks. Is that it? It's the rest of their offerings, which without the iPhone monopoly effects, are Buying Experiences. It's like when people buy $10,000 Mac Studios to "run LLMs", which of course they are going to do like, zero to one times, because they are excited about the idea of the product. For the audience that needs to "run LLMs" they buy, whatever, or rent. But they don't buy Mac Studios. Just because people do something doesn't mean it makes sense.
Is the narrative, AWS Doesn't Make Sense? Okay, you can't go and say, because people do things, it makes sense, because: AWS makes a ton of sense, for basically everyone. Everybody uses it and pays up the wazoo for it. And there are good objective reasons AWS makes sense, at basically all levels. Who is fooled by, "AWS doesn't make sense?"
The problem with AWS isn't even that they are expensive. It's that Amazon is greedy. It could be cheaper, which is a different thing than being expensive. It matters because "AWS stays greedy longer than the average Y Combinator company stays private" is an interesting bet for an investor to take. They could decide to be less greedy at any time, and indeed, it did not take long after offerings of S3-like storage from others led them to simply reduce prices.
What that is telling me is, I could take $100m in funding, sell $1m "racks" of equivalent compute on the Rolls Royce of cloud infrastructure, making everything financially and legally and imaginarily the same as ownership, and then take a $300k loss, right? On each "rack", same as your loss? It's a money losing business, but here I am making the money losing very pure, very arby. Is this what you are saying customers want?
Clearly they want a physical rack. By all means, I can send them a big steel box that provides them that aesthetic experience. Cloudflare, Google, they do the physical version of this all the time: dumb, empty appliances that are totally redundant, because people ask for them. RudderStack, Weights & Biases, a bunch of companies come to mind doing the same thing in software, like so called Kubernetes Operators that literally just provision API keys but pretend to be running on your infrastructure. People ask for Kubernetes operators, they made them, but of course, they don't do anything. They are imaginarily Kubernetes operators.
The reason there are licensing fees and rentals and whatever is the enterprise sales pipeline, right? Enterprise sales is, give people want they ask for. People ask for a price that's below $X up front, so that's what IT vendors do, and then it turns out people are okay with some ongoing licensing fees, so there. That's what they do.
So what IS it?
Oxide has been remarkably transparent about the development and architecture of critical system components. We can only hope they succeed and inspire others to follow their transparency lead.
https://www.illumos.org/docs/about/who/
(Listing all projects using ZFS or DTrace as "who uses Illumos" is cheating.)
That said, Illumos is influential as an organ donor to many others. There are a number of awesome technologies in it.
[0] https://oxide.computer/blog/hubris-and-humility
Latest one still in my to-read pile: https://lwn.net/Articles/1022920/
I absolutely do not have a Solaris/illumos background! The first time I ever sshed into an illumos machine was my first day on the job.
No comments yet
You mean all the huge companies that ran multiple datacenters before the cloud was even a thing?
>We decided to do something outlandishly simple: take the salary that Steve, Jess, and I were going to pay ourselves, and pay that to everyone. [https://oxide.computer/blog/compensation-as-a-reflection-of-...]
Does everyone at Oxide have the same equity grant?
I thought I saw this question answered in a previous thread and the answer was basically “no”, but the question has been avoided a lot.
Aspects of equity compensation would inherently need to be different over time due to valuation, fundraising stage, and so on. However I always thought it was strange that they made a big deal about paying everyone the same base salary but then were silent on the equity comp strategy. Everyone knows that in a job like this the total comp is important.
The old Oxide compensation discussions were interesting. There was discussion about how they thought candidates asking about compensation to be something of a negative signal because they wanted people who weren’t in it for the money, basically. I heard this from a now ex-employee of Oxide who was describing how to navigate their hiring process, so take with a grain of salt.
EDIT: I checked their website again. The compensation link goes to a blog post ( https://oxide.computer/blog/compensation-as-a-reflection-of-... ) which has this section about equity:
> Some will say that we should be talking about equity, not cash compensation. While it’s true that startup equity is important, it’s also true that startup equity doesn’t pay the orthodontist’s bill or get the basement repainted. We believe that every employee should have equity to give them a stake in the company’s future (and that an outsized return for investors should also be an outsized return for employees), but we also believe that the presence of equity can’t be used as an excuse for unsustainably low cash compensation. As for how equity is determined, it really deserves its own in-depth treatment, but in short, equity compensates for risk – and in a startup, risk reduces over time: the first employee takes much more risk than the hundredth.
Which doesn't answer the question.
I've heard this from multiple hiring managers and C levels. The cognitive dissonance is amazing.
Do you know why I show up and work? Because I am paid for it, and in this country, medical is also gatekept by employment.
If I wasn't paid, I wouldn't work for them.
But somehow, I'm supposed to not care about money at the same time caring about money.
I still like the money and the number going up. But now that it’s above a certain multiple of what I consider a “comfortable” life, I’m not worrying as much.
Would for change your job for an extra 500k a year? Surely right? An extra 50k? An extra 5k? An extra 500 dollars a year?
Theres some mental calculus that includes everything. Some people will just take “offer with most money” every time. Hell of a lot of people don’t.
I do think that C suite folks might not have the right vision of what “normal/comfortable” is for employees though. So they might offer a low number thinking it’s actually a “comfortable to live with at this stage of life” number and then get confused why they can’t recruit good talent and think people are obsessed with money.
First offer has gotta be within the ballpark of the right number if you don’t want your interviewee to immediately come back to you with a much higher number!
I agree, but that number for most people is not the $207k/yr Oxide is paying.
For most people that number is likely north of $500k, if not single digit millions.
Independently wealthy folks can stay in the game longer without needing to extract a lot of cash compensation in the company’s early years.
Just about any engineer who isnt independently wealthy is:
- recovering from layoffs and a period of unemployment at a high-COL cost structure
- facing layoffs with the above salients
- facing an imperative to insulate their fucking house with cash for their turn in the above crosshairs
Competence and a willingness to work hard stopped equalling access to basic necessities in November of 2022 - February of 2023, depending on how you count, and inflation has savaged a notional 200k.
"200k is plenty to live on" is rich, well-connected guy talk in 2025.
They’re a remote company. They’re not targeting HCOL metros.
> and inflation has savaged a notional 200k.
> "200k is plenty to live on" is rich, well-connected guy talk in 2025.
Claiming that $200k is not enough to live on is rich-guy talk. The majority of the country lives on well below $200K.
I agree that a single person living in a HCOL metro like SF Bay Area would not find this compensation attractive, but that person also has nearly infinite other jobs to choose from nearby.
Jobs like this (remote work for interesting startup) do not need to pay HCOL comp.
It's bad generally, this is a terrible time to be a working person in general. How SWEs stack up against profession X? Depends on profession X.
SWEs are in a job market where a bunch of folks who have been repeatedly prosecuted for wage fixing (most successfully/recently in 2012) are taking another swing at it in a much more lawless regime. That's as precarious as it gets when this cabal monopolizes the front row at the Inaugeration.
I think this is missing the point.
The target audience for remote jobs that pay $200K does not overlap with the target audience of people interested in working in SFBA at FAANG-level compensation.
If someone is interested in relocating to SFBA, they should do that and get a job there.
Now you have families, debt, etc. There are things. Minimum expectations for family etc. But come on! It’s not poverty wages!
“I am willing to take a pay cut for a thing that I’m passionate about” is such a normal thing that everyone serious I know in this industry says. Or like… even just ethical choices to leave money on the table (there’s a reason online casinos pay their software engineers so much!). Not everyone makes the choice (and I get people saying no) and but in a sense I gotta imagine it’s part of the calculus for making it work. “We won’t have to pay people half a mil in total comp like meta has to, because the mission is more straightforward”. I feel like an O&F ep mentioning someone from intel expecting _triple_ the comp. 600k!
And like… people saying it’s not enough and talking about equity. You’re not paying rent with equity!
Signed: a guy who was at a small startup and who would have been very happy with the inflation/CoL equivalent of 200k instead of what I had those early leaner years
At one point “joining the scrappy startup” does involve some scrappiness. Otherwise you’re just working in a division of Google that hasn’t been integrated into the borg yet.
The "we all get paid the same" is a dishonest by omission. They don't all get paid the same, and while the peanut gallery may think so, I sure as hell don't think the IRS thinks the same way.
I personally don't really care what they pay their engineers, but to pretend to have this egalitarian approach to compensation and then hide the equity numbers is dishonest.
No comments yet
The median US income in 2023 was $39,982 for an individual, and $78,538 for a household.
My issue is with made-for-life, self-appointed elder statesmen on HN saying anything at all about other people's finances and imperatives from the comfort of a study in whatever isyllic community they're pontificating from.
Just, be grateful, and say nothing.
This is a sub-thread about it, so that's what we're talking about though.
> Just, be grateful, and say nothing.
That's not how message boards work. If you say that it's ridiculous to live on such a salary, I'm going to point out how out of touch that is.
This sub-thread is about the habits of speech that make a certain breed of armchair public policy economist jump out like a lump on plate glass. Get Patek in here and we could start a convention.
Okay, just so you know, I did not understand that you were speaking in generalities whatsoever.
I also regret any degree to which I've singled you out for a generally regrettable trend among the long-time community members: it's very easy to see the world through the lens of one's own experience and I've been as guilty as anyone of doing just that on plenty of occasions.
We should all strive for empathy and understanding, that goes double for people like you and me (and Thomas) who have been around forever.
Note that according to https://www.usinflationcalculator.com/ 200k in 2025 is equivalent to about 160k in 2020 when the pandemic began, and 160k would've been on the low end for an experienced software engineer at a Series A or B startup at that time, in the SF Bay Area.
My only reservation is that I’ve interviewed with or worked for multiple companies that made some claim about paying everyone the same and there was always some loophole: The company might have a fixed base pay but then use very different equity grants. One company claimed to give everyone the same base comp and equity but then it was discovered that some people were getting huge annual “guaranteed bonuses” that were effectively base compensation. It has left me tired of seeing companies push the idea of everyone being paid the same while not being open about the entire compensation structure.
EDIT: To be 100% clear, I don’t know what Oxide’s entire comp structure looks like. The examples above were for past companies I worked for.
Thank you. This is the question I was hoping to see an answer for.
If they gave everyone the same equity compensation presumably they’d put that front and center like they do for the base salary.
The claims about paying everyone the same are a red herring because it’s only about base salary.
Sure enough when that bonus was due to pay out, I got a heads up from a friend (who was being compensated because he was like CTO or something) that it was worthless, because of course they get to pick the numbers so they're going to pick zero. I don't care, because I was on a different scheme and anyway I work for salary, if you want to pay me to do something, you can pay me, don't fuck about with nonsense about a "bonus", but some people ended up stuck for a year or two believing they're getting a bonus to wait.
> Congrats on the raise.
Thank you.
The point is not that my friends don't do a good job, the point is that this is work that does not actually further the organization's goals directly, but is necessary in order to keep their job. They'd rather be doing the actual work they are hired to do.
By the way, I received every rating from Greatly Exceeds (including an additional equity grant) down to Meets Most, and the rating I got overall had very little correlation with either effort or impact. I got Meets Most for some of the most valuable and industry-impactful work I've done in my career, and Greatly Exceeds for something that got replaced in a year.
The culture difference between Meta and any startup will be night and day. People who are self interested min-maxxers don't join startups. Not dealing with "corporate politics" has to be in the top 5 reasons anyone leaves FAANG to join a startup. That has nothing to do with Oxide's comp structure.
Oh, sure! Now tell me another one. The idea that startups don't have politics is - well, I'll say it is extremely comedic, and we'll leave it at that.
Think about it for a minute. I'm not questioning the existence of the pipeline here described, and no one is questioning the existence of many pressing reasons for anyone at the FAANG "top of funnel" to want to flow along that pipeline about as quickly as is achievable.
But those "reasons" have effects on the people who experience them, because humans have emotions and psychologies and other such inconvenient externalities, and for like cause those effects are not instantly and perfectly ameliorated in every case by a simple change of environment.
Can you not straightforwardly see how this might produce some extremely adverse results, in a social and sociological sense? And how overt, documented, attributable, and discoverable personnel processes, far from some unreasonable burden, might serve a broadly beneficial role in such circumstances?
Anyway this is mostly just one example, it's just one that comes up often when I speak with my peers about how Oxide works vs other companies.
And since you can't seriously mean me to believe performance is not evaluated at Oxide, I really can't see how I'm meant to take any of what you're saying at face value. Instead it seems something much akin to "don't worry your clever little head about the boring ol' money stuff, darlin'! Don't you trust me to take good care of you?"
Okay, sure. I am also not a "I only want to put my head down and code" person either.
> And since you can't seriously mean me to believe performance is not evaluated at Oxide,
Not formally, no. Because there are no levels, no corresponding salary bands, there's no need to have a formal process, with all of the justification work that has to go in from the employee, and all of the reading and evaluating all of that stuff from management.
It is true that if you don't do your job, you'll be let go. However, that's a conversation that would happen between you and Bryan/Steve, not an annual or quarterly process with all of the paperwork and such that those formal processes demand.
Instead, we simply do our jobs, and get paid our salary.
It sounds like it isn't an environment for you, and that's okay.
And some of "us" have an ownership stake, and some of "us" do not. But "we" like to talk about how everyone's working on a level playing field, anyway.
You're quite right. It isn't an environment for me.
I wouldn't wish to be taken as saying no employee is ever more valuable to the business than another. That would also be absurd. What I don't understand is why all the circumlocution.
How good you think you are at your job is pretty meaningless if some manager above you wants to weaponise the company's perf policy against you.
Hello, Bryan! No, I'm on my own dime, no one else's. But it's decent of you to show such concern over my situation, in these uncertain times.
Because, you know, you better have the same amount of skin in the game as I do.
That's great, but useful to know not everyone thinks the same. When I transitioned to software development (from basically random "whatever pays my rent" jobs), besides my first software job, they were all because I liked the particular product in some way or another, and what the compensation was is basically the least interesting thing for me.
Of course, some level of base payment is needed, because I still needed to pay rent, but if I was choosing between two jobs where one was utterly boring but paid 3 times more than a fascinating job, I'd take the latter in a heartbeat. And no, I'm just an individual contributor who wants to like what I work with, not an executive, manager or similar.
For me, if the hours were equal, I would choose the higher paying one. And then, I would create and make outside of work. And since I have that much higher wage, it could be a jump start on my own business.
And, enough money can buy independenance in that you can get this flexibility of doing as you choose.
Yeah, I guess I've been lucky to be able to chose daily jobs in the past that basically gives me what you would create outside of work, except I got a fixed payment each month for doing something I really enjoyed. So I never had the need to do that stuff outside of work to derive enjoyment of most of my time, which I guess is my top priority and been most of my life.
If you have a team full of people who are just there for the paycheck, the only thing that will keep them there is increasing the paycheck. Which startups can't do in a crunch.
Better to be thinking in transactional terms from the get go especially in early startups, where majority of total comp is an illiquid call option.
I chose my current job against competing offers because it was a good thing for the world, but I would not have taken significantly reduced pay for it. Let me tell you why: nobody that insists on paying you below market rates is going to treat you right. Some of the worst professional interactions I've ever dealt with involved high ranking individuals at nonprofits. These were orgs may have had genuinely good missions, but also paid rank and file employees quite poorly. On the other side, the 3x above market rate job is just a fantasy. I could believe it if you were talking about a 20% bonus.
That is, the work itself should be interesting and fulfilling.
Yes, we need money, but when the work relationship approaches being purely transactional the whole thing is demeaning for everyone and less effective.
Boy, it takes a lot of luck and skill and privilege to be able to shop for (or offer) work like this, and money is still important.
While this is true for most of the cases, it's not the case always. There are definitely jobs I'd work for less than I make at the job now and there are jobs which are considered "dream jobs", but ultimately there needs to be a solid base to make you and your family feel comfortable if you're spending at least 1/3 of your day on.
I used to have a manager that gave me this line. He left this company to join another one, had multiple offers, and told me he accepted the highest one because "it's all about the money".
They know, we know, everybody knows, but that's not the playbook.
It's not an unusual way of thinking, but every time I see it, it seems bizarre to me. If the candidate was to propose any project once hired, I'm sure these folks would want them to think about costs and benefits.
This policy selects either for people unable to reflect on their life with the same wit they apply to work; or people who will front about their motivations. Both seem like poor outcomes.
I think companies avoiding discussions about compensation is a negative signal, because they’re only in it for my labor.
I can't say anything of Oxide because I don't really know the people involved other than reading their writing.
This is an attitude a lot of industry veterans have. Most of them were in software pre-2015 and have long made their money and paid their debts. They saw the haydays of job hopping, massive salaries, massive equity, and "rockstars" (that never were). The people I know that joined software post-2015 and onward are not in the same financial position.
Most valuable people know they’re valuable, and do (and should!) negotiate compensation.
> Everyone at Oxide makes $207,264 USD, regardless of location. (Some sales positions have a lower base salary and contain a commission component.)
On our applications page (see it here: https://oxide.computer/careers/sw-control-plane)
It's also a pretty well known aspect of the company. Combine this with the fact that our hiring process is different, where interviews are the very last thing before possibly being hired, and someone who has missed this fact could come across as having not done some very basic research about the company that they're applying to.
To be clear, I still think calling it "a red flag" is a stretch. I fully agree with you in a general sense, for places that are willing to negotiate compensation in the first place, but we make it very clear up front that we do not.
> To be clear, I still think calling it "a red flag" is a stretch.
In my comment above I did not call it a "red flag". My specific wording was "somewhat of a negative signal". That seems consistent with what you said about judging someone for asking about a well-known aspect of the company because it signals they haven't done enough research.
It also dodges the question that keeps getting asked: Does everyone receive the same equity compensation as well? As far as I can tell, that question is not answered on your website. Asking it seems like fair game.
The person I was responding did, you are right that you did not.
> It also dodges the question that keeps getting asked:
This question gets asked in every thread about this, nobody is trying to dodge anything. The equity portion is variable, and the salary is identical. We do not do bonuses.
It seems that specifically your open disclosure very up front bypasses at least most of this from both sides.
When it comes time to actually cash out or you notice some animals are more equal than others, the excuses start. The drama happens. No one knows what the equity is worth. If you try and advocate for yourself you'll be told the equity is actually worthless.
From here the 200k salary seems fair. Just don't live in SF. Chicago , Philly, Pittsburgh, Cleveland, quite a few cities are perfectly livable on 200k.
In fact, in any of the above metros you will be living nice.
> equity compensates for risk – and in a startup, risk reduces over time: the first employee takes much more risk than the hundredth.
I think that paragraph answers the question pretty clearly. As an Oxide employee you will get equity. It will generally be less than the people that came before you, but more than people that come after you. So it's obviously not the same as everyone else
This is unlike an RSU from a public company, where you can sell the value of your shares as they vest and add that to your income with minor risk of price volatility.
> Since originally writing this blog entry in 2021, we have increased our salary a few times, and it now stands at $207,264. We have also added some sales positions that have variable compensation, consisting of a lower base salary and a commission component.
We have a "one rate per level" rule. The rates are published, and so are the definitions of the levels, and everyone's level (i.e. indirectly you can know everyone's salary)
Worked great, untill we started to look for sales. Doesn't work. They only know incentive-based schemes.
So now they have an incentive-based scheme just for the sales, which is (essentially) budgetted from their stock-option package (that everyone gets). I.e. they benefit from growth a little bit earlier and directer.
If we hadn't done that, we wouldn't have a sales department.
Sales might seem mystical and magical to engineers but it isn’t. A small company with a small sales team can absolutely work without commission. Yes, it is harder, but it is not impossible. The carve out for sales undermines the ideas behind a flat salary structure. Just because we can measure a sales person’s contributions in dollar amounts does not mean we must measure it in dollar amounts. Sales is as much about the partnerships between sales people and product/engineering, why aren’t all the people who work on a deal getting commission?
I’d go as far as to argue that oxide is in the perfect position as a big-ticket long-cycle business to abandon traditional sales commission structures. They take on all the negatives (sales people overselling to get commission) with no benefits. There are other ideas. Company wide bonus based on sales made during the year?
I don't even know if we can.
Yes, you can measure the number of deals signed they called dibs on. But:
1. You don't know if the salesperson earned it, or the whole product. There's a baseline demand driven by the whole company. This is the whole old argument that nobody can prove that ads work; you just can't pinpoint the purchase decision to exposure to an ad. So yeah I guess you can make your salespeople compete against each other and reward the one who stochastically floats to the top while punishing others. Sounds like such a fun workplace, I thought everyone agreed Microsoft's rank system sucked.
2. Several times I have witnessed salespeople selling non-existent, non-planned, functionality and forcing the rest of the company into crunch mode to not have a major client semi-publicly end the contract early. You're often just rewarding the biggest liar while everyone else has to cover up for their shit. Once again, sounds like such a fun workplace.
It comes down to, competitive sales is a cancer, and you're choosing to have it.
This is the fairest form of compensation. It's unfortunate that engineering contribution cannot be measured the same way. If we could engineers would all be getting a nice pay hike.
Basing compensation on supposedly objective things like "the dollar amount a sales person brought in" might be important to a given pool of potential employees, but resist the temptation to think of it as objectively determining the value of the employee's work. Remember that all you're doing is making offers that people will accept.
And those equity grants are effectively as good as cash, since they are publicly tradable stock.
How come it works for basically every other job on this planet? Developers aren't paid per feature implemented/bug fixed, and we still do those things, how come sales people are unable to do things for a fixed monthly salary?
You have to separate out 2 different ideas of the "theoretical idealized salesperson that works for fixed salary" -vs- "real-world salesperson that works for variable commissions".
The businesses that have attempted to pay fixed salaries for salespeople end up attracting incompetent salespeople who can't sell. They become a negative cost on the company's payroll because they can't bring in any revenue. In contrast, the high-performance salespeople (the "rainmakers") are attracted to the variable high-commission, because they know they have the hard-to-find skills to actually sell and bring in the money. If a salesperson has the skills to get a customer to sign a contract and pay money, they have the leverage to get a percentage of that.
Developers, db sysadmins, tech support staff, etc are not in situations to directly influence and shake the hand of a new potential customer and convince them to write a check.
A top salesman can make more than the CEO from commission. Many top salespeople have a zero base salary.
The pressure is pretty crazy, though. I’m not cut out for that kind of thing.
> Many top salespeople have a zero base salary.
Hmm, probably true in some places, but here (Spain) that wouldn't even be legal. When I worked in sales we had minimum wage + commission, but I'm sure the salary would be 0 if they were allowed to set it up like that.
Many jobs will start you with a base for a few months, while you build commissions, but they stop it, after a while.
They can also get fired at the drop of a hat. Not much job security.
Sales are easy to convert to incentives. Just take a cut of the sale. It’s not so easy to calculate value from other jobs.
In the United States having "zero base bay" is hypothetical. If a full-time employee had no commission payouts they'd be compensated minimum wage as necessary to comply with laws.
Sales jobs often come with a warm-up period with either a higher base salary or they get paid part of their commission target for a number of months regardless of how many sales they make.
It isn't that "sales people"[0] can't work for a fixed salary. The good ones just won't because they can find another employer that will pay commission, and they know they will make more with commission than without.
Employers will pay commission because that's how you attract the best sales people, and the best sales people are worth orders of magnitude more to their business than average sales people. Despite how much they earn, in general and compared to their average peers, the best sales people don't cost orders of magnitude more (5x is a more typical spread in tech sales.)
The advantage of 100% commission -- where it is legal -- is pretty obvious from the employer's view point. The company only pays for production. These sales people are commonly (but not always) independent contractors. The benefit for the sales person is a little less obvious, but, generally, they have more autonomy, a simpler comp plan without any caps, and earn more per dollar sold than they would on a base + commission plan.
0 - whether magic or not
Yes they can not. It is not high quality work but high quality results for sales guy. Developer work is complete once service deployed. It wouldn't be developer failure if user volume doesn't reach x thousands per day on their web service. It would definitely be salesman failure sales does not reach x dollars in certain duration.
Developer equivalent of sales would be to say "I have distributed x sales brochures and call x number of clients this month. My job is done."
If a team of developers work together to fix a bug, how would you calculate the revenue value of the bug and how would you distribute that to the team that solved it? Technically the value of a bug is negative because it costs the company, so do you subtract that from the pay of the engineers he worked on it? If 5 people implement a feature that uses a library developed by 5 other people, which was built on the platform team's infrastructure, how do you divide up the commission? It doesn't work.
Sales professionals have a lot of different places they can sell things. The market-rate compensation for sales includes commissions. So to get the best sales people, you want something easy and exciting to sell with a good commission structure tied to the sales.
Top salespeople generally won't work for a fixed salary because they want to make as much as they can, and the way they do that is by having as much of their compensation tied to personal performance as possible.
I personally think more engineers/developers should think the same way, but it's also much harder to directly tie job performance to compensation when contributing to a product.
But that's the same no matter if you work in sales, customer support or many other roles, a lot of people just care about the money with little regards to anything else, yet the sales department are the only ones who must have commission?
It's actually not the same for many roles. See the comments from people in this thread alone who scoff at the notion of maximizing compensation. I don't get it personally, but it's not an uncommon thought.
> yet the sales department are the only ones who must have commission?
I think there's a very high likelihood that a salesperson is primarily driven by compensation, and good salespeople will already be working in a commission-driven compensation model elsewhere.
Why would a top salesperson at Dell, HPE, Oracle, or wherever else a hardware salesperson comes from move to Oxide to take less money and completely decouple their compensation from their performance?
One place I worked I tried to move the quota system more towards being the final response on a resolve issue, but upper management didn’t want to ever judge whether an issue was resolved even when the customer said they were happy. They did incorporate an NPS query for every interaction, though, and a multiplier against the volume-based quota. Unfortunately that favored people who were good BS artists when lying to the customer about looking into things.
The fallout from the above paragraph was that quality, caring staff would get punished for actually solving customer problems.
To get that kind of proportional payback in engineering you'd need very clear financial objectives for a project. I could see that happening in optimization scenarios where consultants are brought in and get paid for whatever they can trim from operational costs.
If they have a fixed salary with a high objective to "make it" (e.g. if you sell less than $X, you get fired), lots of sales folks will skip on it because they can't go over, and most probably prefer to have a quarter or two or year at e.g. 70% salary while working on longer term deals, rather than losing their job for not being good enough within that arbitrary time period. And going over their quota can be wildly lucrative depending on the terms.
Outside the bubble, it isn't always the case, or the structure can be a bit different, but salespeople in the Valley (as it were) are a different breed.
I work with tech salespeople with a variety of former employers as tech sales people, and I've never heard of anyone having worked without a commission. I'm vaguely in tech sales myself (solutions architect) and I'm on commission too, and so is everyone who joins our division from similar employment (solutions engineers/architect, or even customer success folks).
Commission based sales was definitely not a Silicon Valley invention.
It sucks but they like to think that if they work harder they'll get paid more.
Employees apart from the very early ones are likely really getting fucked on equity because oxide explicitly treats candidates asking about equity as a red flag.
Companies structured like this end up turning into a combination of rich people who don’t need money and are just interested in the problem space and then mediocre people who can’t get a better offer. (If you are good, remote work with high TC is definitely available.)
Unless Oxide is giving out huge equity bonuses for good perf (which would make their comp post hypocritical), it’s going to have a continuous talent decline as it grows. There aren’t enough independently wealthy high performers interested in what Oxide is doing to sustain a talent pool.
But how good do you have to be at things other than the work itself (edit: and how lucky as well) to land one of those jobs with higher compensation? For someone outside of high-cost-of-living tech hubs, Oxide's fixed salary could be life-changing all by itself, even with minimal equity. The fact that they take that deal doesn't necessarily mean that they're mediocre.
However I’d also suggest that the concentration of tech in the last decade is also partly due to startups chronically stiffing their employees on equity. The difference in compensation potential naturally forces a talent split where talent joins larger and much better compensated firms.
Are you being snarky and suggesting that employees deserve the same upside that founders deserve?
How is it silly if they already do that for salaries? Co-ops with equal ownership isn't unheard of, and isn't silly at all.
They're a worker owned co-op and have grown very nicely over the years.
The founders are excluded from the employee compensation discussion. They own the company because they founded it. Nobody thinks they just put the equity into a structure that nobody owns.
The question is whether all employees are compensated equally, which is a very important detail. Giving everyone the same salary is very different than giving everyone the same total compensation.
Does the world class engineer or business development lead just take it easy and travel around after they join?
Does the new manager push the team and business forward or prioritize stability?
Do engineers spend their time on reactors and impressive sounding projects or figuring out what customers need?
Do people feel lucky to have a seat in the org or do they spend their time complaining and looking for the exits?
Money isn't the only lever, but its a strong one - startups will never compete with established firms on cash outlays.
But what sorts of things input into the function of "deserve"?
How much equity or salary you get in a company is a function of supply/demand and the marginal product of your labor. I would say there are probably fewer CEOs who can take a company from startup to unicorn status than there are really good founding engineers out there, so CEOs tend to get more equity in a company. Sometimes the founding engineer knows something that nobody else in the world does, so their equity reflects that. It's also a reflection of how much risk the engineer is willing to take on (they'll probably take a salary cut to be a founding engineer, and they also risk the company randomly running out of runway and finding themself suddenly unemployed).
But it has nothing to do with what you deserve. Maybe if the CEO/President is a sentimental type, he'll award you equity based on how much he feels you deserve but ultimately it's about supply and demand.
If a CEO puts in 90 hours a week at a tobacco company while his engineers put in 20 hours a week, does he deserve lots of money (and therefore a more comfortable life) because he puts more effort into killing people? Or does he deserve every bad thing that happens to him because he decided to spend his limited time on this earth making it a worse place?
The founders aren’t really taking on that much more risk than the rest of the early team; it’s the VC’s money, not theirs.
I absolutely don’t agree with the idea that employees deserve the same upside as founders (because I think initiative and persistence against adversity/inertia is insanely rare and valuable and should be rewarded immensely), but it is not an insane proposition.
It’s especially popular among people who think the actual work output is more important than the leadership initiative. Both are obviously essential, and founders do both, while employees do only the first (or they’d be founders themselves).
Let’s define this. Let’s say 1:25? 1:50? What ratio is appropriate?
If they didn’t like the deal, they would become founders themselves, or choose a company that offers a better deal.
It turns out that leadership drive and the compulsion to bring something new into existence from scratch is actually quite rare.
Your figures seem to be roughly in line with what the employment market has settled on, although price discovery could be better (most employees don’t get to see the cap table during hiring negotiation, which, IMO, is wrong).
Plus I predict more companies will exit the cloud once they realize how thick the margins have become or want better guarantees over sovereignty.
There are of course benefits to using cloud based VMs and I use them as well. But you are paying a very steep premium for what is a pitiful amount of compute and memory. There's a lot of wiggle room for price decreases and the only thing preventing that is a lack of competition. There's a reason Amazon is so rich: nobody seems to challenge them on AWS pricing. There's value in having them do all the faffing about with hardware of course. That's why companies use them. I'm in GCP; but same principle. I don't want to have to worry about replacing hard disks in the middle of the night, deal with network routers that are misbehaving, cooling issues, etc. That's why I pay them the big bucks. But I'm well aware that it's not that great of a deal.
I used Hetzner a decade ago and paid something like 50 euros per month for a quad core xeon with a raid 1 disks, 32 GB, etc. Bare metal of course. But also, 50 euro. We had five of those. Forget about getting anything close to that with modern cloud providers for anything resembling a reasonable price. Your first monthly bill might actually add up to enough to buy your own hardware. Very tempting. They have beefed up their specs since then. You now get more for less. And they also do VMs now.
With on-demand pricing the pod would pay for itself (and the cost to manage it) within a year.
It would still likely be much cheaper to do everything in house, but you would be assuming a lot of risks and locking yourself in losing flexibility.
There is a reason people go with AWS over many competing cheaper cloud providers.
But at the high end, I think the market is litterally infinite. Every large company should want this, and want it now. Cloud providers are extremely expensive and, outside of the 1-tier where prices are really outrageous, they perform poorly and often offer little support.
This really feels like the future.
Anyone can throw together a bunch of parts and software to run Internet-facing services from a closet. That doesn't mean that you're safe from issues that Oxide aims to solve, especially at that small scale.
My homelab (which hosts my blog and a couple of other things) runs off a Topton N17 micro-ATX motherboard ordered on AliExpress, featuring an AMD Ryzen 7 7840HS. Yes, that's a mobile CPU shoehorned onto a desktop platform with a funky mounting bracket to take AM4/AM5 coolers.
Anyways, I wanted to run SmartOS on it, but this system is so janky that the Illumos kernel couldn't find any PCIe devices at all. After spending an afternoon reconfiguring PCIe bridges by hand with the kernel debugger in an attempt to troubleshoot PCIe initialization, I gave up and installed Proxmox.
Admittedly, as far as janky hardware this takes the cake, but the point stands. To paraphrase Bryan, buggy firmware is the sysadmin's worst enemy.
Now a lot of the things that were done pre-cloud were done in bad ways, and I'm not saying that we were right about those things. Having APIs for provisioning and monitoring are far better than submitting a request to some queue and having your VM provisioned manually 1 week later by someone who gets a key detail wrong. APIs and granular permissions are how this should be done, and "the cloud" taught everyone that very early. But a lot of companies are really stuck in the cloud mindset now, and won't let go of it.
I think companies like Oxide and product lines like theirs are going to start becoming common. Microsoft, of course, completely fumbled the ball with Azure Stack, and I've never even heard of anyone deploying AWS Outpost, both for the same reason: the costs for these are absolutely insane for what they provide.
What most folks really want is their own infrastructure running their own stuff using APIs that are either written in-house or provided by some vendor. Oxide is betting that they can sell you a working scalable system for less money than it would take to hire a team to write the APIs that would allow a company to do the same with off-the-shelf hardware. I think that they're probably right about that.
I hope you can see that this is a logical fallacy known as "zero-sum thinking". It is not only possible for a business to profit while lowering prices, it is universal throughout the economy. Tomato farmers make a profit selling tomatoes at a price much lower than the cost to grow tomatoes at home. Bakeries radically undercut the cost of home baking. It is obviously cheaper to buy motor fuel at the gas station than it would be to buy crude and refine it yourself.
The main reason people think their on-prem is cheaper than cloud is that they are bad at accounting.
> [2023] 37Signals expected to save $7 million over five years by buying more than $600,000 worth of Dell server gear and hosting its own apps.. [2024] update: it's more like $10 million (and, he told the BBC, more like $800,000 in gear). By squeezing more hardware into existing racks and power allowances.. transferring its 10 petabytes of S3 storage into a dual-DC Pure Storage flash array, 37Signals expects to save money, run faster, and have more storage available.
> Tomato farmers make a profit selling tomatoes at a price much lower than the cost to grow tomatoes at home.
This is because at home, you have an elastic need for tomatoes. One week you need a few, the next week you need none, the next week you need a lot. In that case, yes, growing your own tomatoes would be very silly. (This part of the analogy works with on-demand instances.)
However, if you aren't a home, but you're a busy restaurant, you're not buying tomatoes from the grocery store. You have a regular, fairly fixed capacity, and so you go with a produce vendor who's able to serve that need at a decent price. Part of the reason you're able to get a cheaper price is through volume and due to the regular-ness of the business. (this part of the analogy works with reserved instances.)
Okay, so let's move from tomatoes to the actual building of a restaurant itself. Similar to a reserved instance, renting a building is a decent way to get started with less capital, and you have fairly consistent capacity requirements. But at some point, you realize what McDonalds did: owning the building and land beneath it ends up being a great deal at certain scale. Because that ends up being cheaper still, in the long run. This is closer to on-prem. (Okay at this point this analogy is getting pretty silly but it was fun to try and work through it...)
So, the trick is, for a lot of organizations, they could realize the benefits of owning their own hardware, but to get back to your original analogy, running your own hardware comes with its own set of costs that may make it not worth it. You have to have staff to operate everything, you have to manage all of the various supplier relationships, keep track of software licensing fees, etc etc etc. Even with all of this, as my sibling comment shows, often this can be cheaper than using the cloud.
But one way of looking at Oxide is, we are making it so that it's simpler to own your own hardware, thanks to all of the integration work we do. You don't have to manage a ton of vendor relationships, you have "one throat to choke," as they say. You don't have to keep track of software licensing fees, there are none. You don't need to build out your own software to put the whole thing together, we give it to you. Etc.
So yes, just like a household is best served by going to the supermarket, individuals aren't ever going to buy Oxide. But there's a lot more out there than just households. And larger organizations have fundamentally different needs than they do.
> The main reason people think their on-prem is cheaper than cloud is that they are bad at accounting.
I mean, there's also base accounting stuff that differs significantly between the two, like opex vs capex spend. Not that I'm an expert in that, mind you.
To stretch the metaphor to a grotesque extent, I think Oxide stands in the middle between the home-grown and the industrial tomato. Your average corporate IT installation has the same economics as home-grown. Even if they have 1000 potted plants, they are still potted plants, and they are still $100 tomatoes. EC2 is a 5000-acre California tomato grower where the fields have been leveled using lasers and the fruits are harvested by robots driving themselves using on-board GPUs. Their tomatoes cost 5¢. An Oxide computer is like having a 1-acre kitchen garden where the tomatoes are in rows. These are more like $1 each. The economics are undoubtedly better.
That's fair! Just like, pointing out that on-prem can make financial sense.
> To stretch the metaphor to a grotesque extent,
I like it, haha.
You can "just" migrate by exporting or importing the vms.
You can "just" migrate away from Oxide but that would mean throwing away the hardware you now own. That's the grandparent's point; if you're migrating out of a cloud to avoid the margins demanded by the cloud vendor, now you're at the mercy of whatever Oxide thinks your support contract is worth.
Sure, the convenience may be worth it, but watch how many companies are now struggling to get off of VMWare after Broadcom moves.
That’s the only thing I can tell is useful about “the cloud”
I can build racks and servers easily, but the challenge is availability and getting past everyone’s firewalls
So the real win is any service that allows for instant DNS table updates and availability of DNS whitelisting.
This is why Google, Msft etc win in email because they have trusted endpoints
Alternative routes with self signed DKIM etc is more or less blocked by default forcing you onto a provider
We need more cloud flare tunnel and local hosting via commercial ISP routes and less new centralized data centers
I've also been doing web-related work for a living for over 25y and yours is the most spot-on take I've seen in this discussion.
I'm literally so old that I write programs that run on a server and never think about infrastructure.
I agree that's a bit awkwardly phrased, let me send in a patch for that.
> Does this mean treating your own servers like "serverless?" Does it mean running Kubernetes? Is this primarily for people who want to self-host LLMs?
Not exactly any of that. We let you treat an entire rack as a single pool of resources, spinning up virtual machines that our control plane manages for you. Think "VPS provider but you own it." There's an API, but if you want to see what our console looks like, you can poke around with a demo here: https://console-preview.oxide.computer/
Machine/system/service deployment via API.
See §Essential Characteristics
> On-demand self-service; Broad network access; Resource pooling; Rapid elasticity; Measured service
* https://en.wikipedia.org/wiki/Cloud_computing
None are generally applicable to standalone pizza boxes as managed individual (as opposed to being herded by (e.g.) OpenStack).
Sadly when I look at their jobs posted I don't see much that would line up with my skillset, but I keep an eye on them just on the offchance.
And such a clear value statement.
If I could, I'd invest. Sure, they might fail, but they're shooting their shot, and to me it has a clear differentiator that would improve the market for most of their users (if not the incumbents).
Folks seem to be moving toward liquid cooling[4] either to the rack/chassis[5] or even to the chip[6].
[1] https://oxide.computer/blog/how-oxide-cuts-data-center-power...
[2] https://www.youtube.com/watch?v=4vVXClXVuzE
[3] https://www.youtube.com/shorts/hTJYY_Y1H9Q
[4] https://blogs.nvidia.com/blog/blackwell-platform-water-effic...
[5] https://datacentremagazine.com/data-centres/top-10-liquid-co...
[6] https://zutacore.com
If the customers leave these things idle, then oxide is going to shine. But a busy rack is going to be dominated by CPU heat.
* https://www.youtube.com/watch?v=hTJYY_Y1H9Q
From their weblog post:
> Compared to a popular rackmount server vendor, Oxide is able to fill our specialized racks with 32 AMD Milan sleds and highly-available network switches using less than 15kW per rack, doubling the compute density in a typical data center. With just 16 of the alternative 1U servers and equivalent network switches, over 16kW of power is required per rack, leading to only 1,024 CPU cores vs Oxide’s 2,048.
* https://oxide.computer/blog/how-oxide-cuts-data-center-power...
It's just plain old engineering, optimized to sell whole racks not individual servers or <=8U units, sprinkled with opinions about low-level firmware etc, with a bespoke OS and management stack.
It's also about what we don't have. We don't have a UEFI, for example, which means we don't have UEFI vulnerabilities.
Scaling from the 8U (that blades could already do in the 90s) to full rack as the unit of "slide unit in to connect" DC power and networking is way cooler than using 80mm fans.
Re UEFI: I feel like that part is less about UEFI itself and more about how you have very minimal third party firmware.
I'm pretty excited about openSIL and such in general. If only AMD could execute well in the world of software.
Yes, "just".
[0] - https://www.youtube.com/watch?v=dHbgjB0RQ1s [1] - https://www.youtube.com/watch?v=lJmw9OICH-4
you're right that there are efficiency limits, but not once in my career have I ever seen anyone even attempt to write their code so that it is efficient to run, outside of gaming.
https://signalsandthreads.com/the-thermodynamics-of-trading/
> Our thesis was that cloud computing was the future of all computing; that running on-premises would remain (or become!) strategically important for many; that the entire stack — hardware and software — needed to be rethought from first principles to serve this market; and that a large, durable, public company could be built by whomever pulled it off.
Very clear and logical, stating from their first principle world view what the result could be if they succeed.
I thought that Oxide was based on OpenCompute, which is basically the rack designs that Facebook open sourced, after hiring some Google employees to build their custom data centers. This project started in 2011:
https://en.wikipedia.org/wiki/Open_Compute_Project
https://github.com/opencomputeproject
Google definitely rebuilt the stack from first principles -- the data center was basically a huge embedded system, from power to racks to CPUs/memory/disk/network to kernel to user space to cluster software. (And no, they did not use Kubernetes.)
I have no idea how active the OpenCompute project is -- is Facebook still the main contributor, and are they still releasing their new rack designs?
And I also wonder how much Oxide has diverged from it? At least on the hardware side. On the software side, I guess the Illumos-derived parts and Rust parts are completely different.
Well, when they say they did their own:
Then yeah it seems like maybe only board designs and the switch COULD have either come from or been influenced by OpenCompute, but maybe those didn't either. (I have no idea tbh)Maybe they only got the mechanical and power stuff from OpenCompute? i.e. the parts that change more slowly
So in the end, even the mechanical and power didn't come from OCP. We clearly build on other components (we didn't build own rectifiers!), but we absolutely built the machine from first principles.
* https://oxide.computer/blog/how-oxide-cuts-data-center-power...
* https://docs.oxide.computer/guides/introduction
I feel like we had a good Oxide and Friends on this too... https://oxide-and-friends.transistor.fm/episodes/bringing-up... has some info about our power setup.
Anyway, I barely know anything about this topic, but I think this answers your immediate question: we convert AC -> DC once at the rack level, and then use a bus bar to distribute that to each sled. Each sled also has a converter to convert that 54V down to 12V for its own bus within each sled.
Why does it have to be a public company though?
The ultimate aspirational homelab setup, ngl.
Would love to see their growth result in more versatile options, like quarter-rack or industrial deployments someday. In the meantime, congrats on the successful fundraising!
USIT... what a cryptic website! Is it government-related (like In-Q-Tel) or private? Have no idea...
https://rfd.shared.oxide.computer/
Start from RFD 1 ;)
[0] https://oxide-and-friends.transistor.fm/episodes/rfds-the-ba...
I'm a big proponent of the "writing is thinking" mantra. Unfortunately, in my experience, not all technical leaders value grassroots proposal processes like the Oxide RFDs
Edit: some popup on their page links to https://github.com/oxidecomputer/rfd but it's a 404
Edit2: it's at https://github.com/oxidecomputer/rfd-site
https://newsletter.pragmaticengineer.com/p/oxide
In 2027 - 2030, We will have 256 Core Zen 7 CPU with PCIe 6.0 or 7.0 SSD and Network. If Liquid Cooling ever come to Oxide we are looking at 5 - 10x the compute power of its current hardware.
Somewhere along the line a Single Oxide Rack would offer enough Compute and Storage for 95% of customers. And whenever I think about having Solaris in every rack just put a smile on my face.
It's more of that we're a young company, so we can only do so much, so quickly. Plus, because we do so much custom work, that all takes time. As we grow and scale up, we'll be able to move forward more quickly on updates on the hardware front.
Took them 3 months before a "we're not interested" email was sent. No reasons, either.
I probably should have just used an LLM to generate good sounding garbage. Probably the same chance to get even a stage 1 interview.
We don't do "stage 1 interviews", we only do interviews as the very final step in the process, when we've narrowed things down to a handful of people. That initial packet is like 85% of the process.
I didn’t realize at the time, but Oxide’s application process was the best form of interview prep I’ve done. The process forced me to thoroughly document my values and career accomplishments. In later non-Oxide interviews, I effectively recited what I had written my materials. In that way, it has felt less one-sided than every other company application process I’ve gone through. I was able to take away an artifact from the experience, versus being filtered out via a coding challenge. It’s also been rewarding to reflect on my submission from years ago to see how my mindset and skills have evolved.
If you have any interest in working in the pediatric telemedicine space, I encourage you to email me your application. We accept Oxide materials. I’m happy to provide feedback as a hiring manager. My email and our company website are in my bio.
Well, its the assymetry of wanting a 10 year CV with various orthogonal points in your career.
Unlike an actual interview, which is equal time investment, this 20 page paper gets the commentary and result of "no". "No" what? You can ask an interviewer about concerns, and discussion points. This email from no-mail@ is just nothing.
And its not the sting of rejection. I've been turned down, and I too have turned down. But its the mechanistic, dispassionate, legalistic response after months of a "No". And not even a 'What we're looking for is.... '
(random superficial comment: the ascii art + high fidelity ui combination on the oxide landing page is chef's kiss)
I think it brings an interesting point actually.
"Who will buy these", the obvious answer is anyone with a need, but the "standard pizzabox" server is ubiquitous for the same reason that x86 and miniPC's outcompeted mainframes.
((controversial take warning))
Mainframes are objectively better at high uptime and high throughput than rube-golderging a bunch of semi-reliable x86 boxes together, yet, the ubiquity of cheap x86 hardware meant that the lions share of development happened on them.
People could throw a pentium 2 PC in a corner and have it serving web traffic, and when things started growing too much you could add more P2 machines or even grab a Xeon 4socket machine later down the line.
This isn't possible with mainframes, and thus, people largely don't mess with them.
The annoying thing is that this kind of problem has some kind of stickiness effect. If you need a server, and then another, you buy them as you need them and if you're already 20 pizza boxes in; it's a pretty big ask to rip them all out and moving to a different vendor entirely than staging replacements one after another.
So I guess their target audience is the "we don't want to touch cloud" organisations that have a good IT spend that are willing to change vendors?
I don't think I've worked for any of those.
(FD: I'm actually a fan of the Oxide team, and the concept, and I would buy into the ecosystem except I have needs that are at most 3 servers at a time)
Also, I'm given the impression that Oxide prioritizes user experience - their website shows off a clean UI and they presumably have modern, easy-to-use APIs. Mainframes, in contrast, seem like a whole different world - if I convinced my company to move to a mainframe, who would even operate it? I know modern mainframes are closer to "normal" servers than their old reputation, but still, I'd imagine it's pretty esoteric stuff, and IBM is famous for not being the cheapest to work with.
I do find it pretty funny that their business model seems to be reinventing mainframes, but I feel like there are important distinctions too. Hopefully they do well (I'd also love to have access to this stuff, but yeah, same "needs that are at most 3 servers" deal).
The market is complex. Those who will buy will be those who find that the existing ying doesn’t snap perfectly into their own business’ yang. They’ll be at the margins first (the post references a lab for instance, not a booming tech company), then over time less so.
Companies do modernization/migration projects from time to time; I guess one way to solve the audience issue is to find companies that have such a planned event and try to market a “better” alternative.
While I’m also a fan of Oxide; my primary concern is whether they can actually get companies to ignore the marketing that comes out of cloud services.
They can migrate to an Oxide "cloud" without too much difficultly as opposed to procuring, installing, and maintaining the rube goldberg machine you mentioned.
They also attract interest among the "we don't want to touch cloud" organizations where trying out $1M in hardware is a rounding error, but I don't know how much traction they'd end up getting.
The flat salary structure at a generous level (from my perspective, anyway) is a breath of fresh air. Everyone getting caught up on the equity is a bit hard to understand, given the clarity of the message from the company.
I will be applying for one of the open positions. Kudos to this company for their approach to business, and congrats on the success.
It is always a pleasure to follow up with Oxide on their podcast, their technological decision to keep the Solaris linage alive, all the places across the infrastructure they have been using Go and Rust as well.
> An oxide rack has a minimum cost of something like 600k not including all the infra you need to run a rack, maintenance, and then needing to upgrade
So maybe not super useful for people who are looking to do some home-lab stuff or even setups for SMBs.
Edit: Another thread: https://news.ycombinator.com/item?id=36552556
> My guess is that a base config would be somewhere between $400K to $500K but could very definitely go up from there for a completely "loaded" config.
(other people's) previous guesstimates were 500k - 1M. It does look like you can order it partially provisioned (compute wise I'm guessing) and expand later.
[0] https://news.ycombinator.com/item?id=38498840
just want to give a shout out to my old boss from the mid 80's who had researched it (mgt consultant) and told me at that time that cloud computing was the future of all computing because the economics were inescapable.
RIP.
With this news I hope they plan on expanding hiring for frontend devs soon, would love to work with such leadership once in my life.
Yes.
> Then how does it bring cloud scalability?
You buy an entire (or half) rack at a time, and then can treat the entire thing as one elastic pool of resources, you do not need to manage the individual sleds within the server yourself. Your interface to the rack is similar to a VPS provider, it's "give me a new vm with these specs."
Happy to elaborate if you have more questions.
Could be a need for unclassified workloads also… but curious if this is a defense and Intel community venture fund backing this next round with my tax dollars.
USIT > U.S. Innovative Technology (“USIT”) is an investment firm that backs growth-stage commercial companies with critical technologies relevant to the national interest, including, artificial intelligence, future of compute, new industry, space & communications, bio & healthcare, and defense tech. USIT was founded by American technologist and visionary investor Thomas Tull.
joined by: Riot Ventures, Eclipse, Jane Street
I was happy to learn about Sweater Ventures https://www.sweaterventures.com/our-story (and their kind) which are opening up access to investments, and also helping ensure the entry price is quite low (for example I invest $50 a month with them) .
It is my hope that in the future you will be able to order a micro fraction of any company as easily as you could a starbucks.
And IMO part of that equation might be to have the state start to work against contracts which restrict your rights on your own property (essentially contracts restrict when you can sell your shares, usually not until IPO or a company organized liquidity event)
Also love the Oxide and Friends podcast! What strikes me most lately about Oxide since falling into their hefty episode backlog, is their book club culture. I really appreciate the ability to get a fly on the wall experience of it, I learn a lot!
https://oxide-and-friends.transistor.fm/
> With growing customer enthusiasm, we were increasingly getting questions about what it would look like to buy a large number of Oxide racks. Could we manufacture them? Could we support them? Could we make them easy to operate together?
i.e. they need the capital in order to be able to satisfy large orders on sane timeframes - but that's very expensive when you're a hardware business.
https://oxide.computer/remote-access
> It seems like this is only tailored to large enterprise sales.
Since we sell half or full racks at a time, it's true that we're geared towards larger companies, as small shops just don't need that much computer.
> The only other option is just using them as your AWS replacement.
That's the use case, yep!
#1: Don't expect to see it until after AMD or someone else makes a product that actually manages to compete against Nvidia. Nvidia is pretty hostile to not running their low-level software stack, and Oxide is all about the legacy of Solaris.
#2: AMD MI400 or relative will be an extra chipset on future server motherboards (not a separate PCI card). Simultaneously, the boundary between "CPU vector processing" and "GPU used for transformers" will blur, and the chipsets will slowly merge into chiplets in one package.
#3: AMD MI400 and such AI accelerators will be primarily sold as full racks with its own custom "networking" (UALink switch), and the actual host CPU on those devices will be lower specs and mostly relegated to setup and metrics of the AI work, much like storage and networking appliances are built, AI workload will not even pass through the host CPU. I'm not sure Oxide can compete in that world. The "business logic CPUs" will reside in a different rack.
[0] https://oxide-and-friends.transistor.fm/
Cool 1999 aesthetics though
Do new internet users not know that the landing page usually contains information about the product they're talking about in their blog posts? 99% of the cases you can find what you're looking for on the landing page, and it took me a whole of 30 seconds to get here, writing this comment took longer time.
Which is kind of wrong, because there is nothing elastic nor "on demand" about metal you buy.
If you have to manage the hardware yourself, have to plan and pay for upfront for the maximum capacity you would need, and there are fixed limits you can hit and have to plan around yourself, it's not elastic.
And then as a follow up you have to explain that
- they sell an entire rack full of servers
- they're the only ones that do this. Normally you have to buy all the pieces and put it together yourself, or pay someone to put it together for you but all the parts are kind of designed on their own by different companies so it's kind of a mess. Oxide makes one big rack with like 16-32 servers and it's all designed by them and just works, so you just plug it in and you have servers you can put a bunch of vms on. Oh and they're huge, each one literally costs like a million dollars
Company Name Single line Headline
Problem Our Solution
Gives you the entire company premise and product description.
Seems pretty clear to me.
There are many things that suggest free software and the movement for software freedoms might be on its way to a historical footnote. This is absolutely not one of them.
Hey Bryan, one day when you’re very successful market-wise (you and your team have already obviously been massively successful from an engineering standpoint) and aren’t in crash-priority-override mode to get cash flow, please consider a project to build SME stuff that reaps the security and integration benefits of your big enterprise stuff that is affordable for end users like entrepreneurs and home hobbyists, like Ubiqiti does. I’d love a lil’ $5-10k homelab unit, and I bet a number of smaller universities and organizations would go for stuff in the low 5 figure 2-3kW range. Obviously your bread and butter comes from companies that size their orders by number of racks, but if you never go downmarket then thousands of us hackers that love what you’re doing will never get to touch Oxide stuff except at a job in a megacorp.
https://artemis.sh/2022/03/14/propolis-oxide-at-home-pt1.htm...
(The author of this blog post now works for Oxide!)
In exchange for your own hardware purchase cost, in practical terms also a license.
> We did our own integrated storage service, allowing the rack-scale system to have reliable, available, durable, elastic instance storage without necessitating a dependency on a third party.
In exchange for an unbreakable dependency on the first-party solution.
I'm being overly aggressive because I do lurve your product and the Sun/Apple way of vertical integration is especially valuable for security ... things break at the interfaces and since you have absolute control over that, you can be actually good. Then there's the improved UX that comes with an integrated product. The root of trust work you've done is especially noteworthy, in a sea of also especially noteworthy efforts across the entire vertical product.
But I'm leery that with the absolute lock-in, and VC pressure, you might succumb to squeezing your customers a la AVGO.
Also, is your username something interesting? It feels familiar but a quick `echo -n '' | md5sum` didn't yield anything.
in the midst of everyone making a land grab for GB200s, does anyone have time to evaluate their alternative OS?
https://en.wikipedia.org/wiki/Thomas_Tull
$100M is a lot of money investors want to see returned of the total amount raised of almost $200M?
Remember Oxide is VC backed so there must be some strings attached here, is it an IPO or an acquisition for an exit or just staying private?
"Our thesis is [...] and that a large, durable, public company could be built by whomever pulled it off."
So the goal is an IPO.
Also, what they do is very capital-intensive, so I’m not surprised that they’re raising more money.
The "secret sauce management layer" is available at https://github.com/oxidecomputer/omicron, released under the MPLv2 license.
(I work at Oxide)
In my mind they’re much more like an SGI, Sun, IBM, DEC, or Apple type of play than merely an integrator.
There used to be lots of them, but they all had a very rough time after the 90s when cheap x86 boxes started to become ubiquitous.
I have no idea if Oxide will succeed or not, but I sure hope so. If it goes well they might become the Sun of the 20s.
they produce a private cloud in the form of racks you can buy then just plug in to power and ethernet and run. also, they did a bunch of work so the OOB management isn't fucking terrible, and it uses way less power per FLOP because they bothered to, for example, "make the fans work properly".
Dell will sell you a thousand servers you can then buy racks for, then rack yourself, then buy switches from Aruba, then plug all the switches in to all the computers, then pay VMWare for an vm-cluster-OS, then you can install that, then when something goes wrong you get to call up Dell, Aruba and VMWare and have them all tell you it's someone else's fault.
you...don't get the difference between these two situations?
The founders are uber geeks but have never done anything successful on their own. I predict this company will be another zombie.
That's the high level, happy to elaborate if you have more questions.
It’s a 7-foot tall rack with compute sleds, storage sleds, and network sleds. It has its own BMC design, its own power design, its own physical connectivity design, its own virtual networking design, its own hypervisor (although it’s based on Bhyve), its own OS (although it’s based on Illumos), and its own API to spin things up and configure them.
As I think of it, it’s basically a private cloud in a box and The Register wasn’t far off.
The “iPhone” of the data center.
Oxide is kind of like Sun Microsystems, building polished vertically integrated monster machines, e.g. Sun E10k.
* https://en.wikipedia.org/wiki/Sun_Enterprise
These are decisions that the CEO is making, which means they're distracted. This is fine when you've received nearly 200 million in total funding, but won't work once you're expected to add the same level of value while being profitable.
Just to be clear, you mean that we have a BlueSky account, in addition to X? I struggle to think of what you mean.
Generally speaking, advertising on a wide array of platforms is considered a good thing, as you reach different audiences.
This feels the same as past startups where I thought I hit a pmf because of how excited "potential" customers got when I mentioned politics. We built out "political" features, came back, and none of them converted but the excitement grew stronger. Politics is a trap because it adds no value, drives away potential real customer bases, but you will get enormous positive reinforcement because people are excited you're pushing their brand of politics. In my mind, there's a risk you start creating teams to manage "corporate culture" and brand outreach, and if politics sneaks into management they'll actively steer the company in the wrong direction.
Also I'm sorry, if you're actually an executive at oxide I don't mean to be harsh, I thought I was speaking into the void. I've witnessed this destroy companies I've worked on and been involved with, and doing something like only listing a bluesky account is exactly the kind of thing that's a distraction which costs potential real customers.
I agree that it's difficult to balance features customers say they want vs the ones they'll actually convert over in an early stage company.
I just don't think "has a BlueSky" means that that is what happens.