Sponsored

Swezey

Well-Known Member
First Name
Matt
Joined
Jul 18, 2023
Threads
4
Messages
207
Reaction score
260
Location
ATX
Vehicles
'23 R1T QM LBP 21" Rivian Blue
Occupation
Software Engineer
Clubs
 
As a 10-year SWE myself; this was avoidable. This should have been pushed to a small in-house fleet of vehicles where all params were 1:1 except for being grouped as the initial launch phase.

Not to mention the internal testing phases before getting to that point.

It happened, it shouldn't have happened. Hopefully, they will take the necessary steps to avoid this in the future.

But I sure as shit won't be jumping to updating day-1 of any new updates any time soon until one of you fine people do it first haha.
Sponsored

 

Kenmecca

Well-Known Member
First Name
Ken
Joined
Jun 21, 2021
Threads
2
Messages
194
Reaction score
225
Location
SF Bay Area
Website
www.Directlineanswers.com
Vehicles
R1S; Audi A5
Occupation
Business Owner
One does wonder if hackers could get into Riv servers and brick all our trucks
 

Dark-Fx

Well-Known Member
First Name
Brian
Joined
Jul 15, 2020
Threads
148
Messages
13,616
Reaction score
27,551
Location
Michigan
Vehicles
R1T, R1S, Livewire One, Sierra EV, R1S
Occupation
Engineering
Clubs
 
As a 10-year SWE myself; this was avoidable. This should have been pushed to a small in-house fleet of vehicles where all params were 1:1 except for being grouped as the initial launch phase.

Not to mention the internal testing phases before getting to that point.

It happened, it shouldn't have happened. Hopefully, they will take the necessary steps to avoid this in the future.

But I sure as shit won't be jumping to updating day-1 of any new updates any time soon until one of you fine people do it first haha.
Internal testing vehicles are probably allowed to run unauthorized software.
 

Sponsored

Mathme

Well-Known Member
First Name
Matt
Joined
Jul 25, 2022
Threads
3
Messages
1,378
Reaction score
1,814
Location
Los Altos, CA
Vehicles
R1T: El Cap, OC, 20AT, Off road package
Occupation
High Tech
I'll start with a "this should never have happened" and Rivian should have had better safeguards in place to prevent this.

Now there are two important things to note moving forward:
  1. How does Rivian get in front of this and address it? Any crisis intervention specialist will tell you the key is communication both during and following the event. Rivian knows which vins are affected and they need to start communicating with those owners as a priority.
  2. We as owners need some sort of communication as a debrief stating what happened, what Rivian learned from incident, and how they will change the process moving forward so things like this don't happen again.
 

Dark-Fx

Well-Known Member
First Name
Brian
Joined
Jul 15, 2020
Threads
148
Messages
13,616
Reaction score
27,551
Location
Michigan
Vehicles
R1T, R1S, Livewire One, Sierra EV, R1S
Occupation
Engineering
Clubs
 

COdogman

Well-Known Member
First Name
Brian
Joined
Jan 21, 2022
Threads
33
Messages
11,641
Reaction score
34,494
Location
CO
Vehicles
2023 R1T
Occupation
Cyber defender
Clubs
 
I credit cohesive oversight when things go smoothly.
As a 10-year SWE myself; this was avoidable. This should have been pushed to a small in-house fleet of vehicles where all params were 1:1 except for being grouped as the initial launch phase.

Not to mention the internal testing phases before getting to that point.

It happened, it shouldn't have happened. Hopefully, they will take the necessary steps to avoid this in the future.

But I sure as shit won't be jumping to updating day-1 of any new updates any time soon until one of you fine people do it first haha.
I do know for a fact Rivian does put upcoming software into in-house and employee vehicles before release to the rest of us. I don't know for how long or any other details about it.
 

COdogman

Well-Known Member
First Name
Brian
Joined
Jan 21, 2022
Threads
33
Messages
11,641
Reaction score
34,494
Location
CO
Vehicles
2023 R1T
Occupation
Cyber defender
Clubs
 

jeeden

Well-Known Member
First Name
Jeremy
Joined
Oct 27, 2020
Threads
57
Messages
1,087
Reaction score
1,636
Location
Northern VA
Vehicles
Rivian R1S, 2016 Ford Escape, 2015 Ford Mustang GT
Occupation
Project Manager
Clubs
 
One does wonder if hackers could get into Riv servers and brick all our trucks

Well that has been debated for some time about all "smart" cars. Don't confused development with cybersecurity. I actually talked online with their cyber office at one point when I was considering a job move and they seemed to have some rep so I'm confident. Remember, this issue is technically BECAUSE the software stack is secure. If the vehicle didn't care about certs, it would be working fine.

After reading the discussion about how much connectivity the vehicle still has, I am much more hopeful they will be able to sort out the issue with another OTA than I was going to sleep last night.

The lack of information/movement on the issue from Rivian is probably making us all assume the worst, but remember the best thing to do in situations like this is to STOP, and assess what happened, what is the proposed solution, what could go wrong with that, and work the problem. Just dumping the correct certs in and pushing back out as fast as possible is asking to make the situation worse. I would note that NOBODY is getting an update now including the people who don't have failed updates. Of course, Rivian could put the correct certs in and push it to them at least, but I'm sure they are doing a full assessment of the situation for all owners and then act.

Other than comms (I agree they should have an official email out to people since not everyone is here, on Facebook, in the Reddit forums, etc), In this type of situation you want to be a stone-cold card counter and I think they are doing that.

We could be dealing with this a week from now, but we could very well be sitting here tomorrow after they push the full OTA back to everyone tonight and be talking about how we were worried we needed to go to a SC, stock price impacts, and impacts on the Georgia plant production with giggles.
 

Sponsored

SDH

Well-Known Member
Joined
Dec 13, 2022
Threads
10
Messages
737
Reaction score
1,330
Location
NC
Vehicles
R1T LE; Jeep Rubicon
Updating too. Glad to get it updated before I drop it off for maintenance on Wednesday
Oh dear ... at least it's going to the SC anyway !
 

SDH

Well-Known Member
Joined
Dec 13, 2022
Threads
10
Messages
737
Reaction score
1,330
Location
NC
Vehicles
R1T LE; Jeep Rubicon
One does wonder if hackers could get into Riv servers and brick all our trucks
I'm sure the Russians and Chinese have already thought of that.

Who here wants to slam ICE cars now?
 

Zoidz

Well-Known Member
First Name
Gil
Joined
Feb 28, 2021
Threads
226
Messages
5,204
Reaction score
11,705
Location
PA
Vehicles
23 R1S Adv, Avalanche, BMWs-X3,330cic,K1200RS bike
Occupation
Engineer
Needs more lint !! (inside joke for some of us old software devs.)

I am kinda suprised each system doesn't have its own recovery partition (for lack of a better term) that allows a safe mode reboot, where updates could be safely reapplied. Further, I guess I would have also expected somewhere in the truck would be a USB port for hail-mary rebooting of recovery software, in the event of an OTA or signal/reception hard failure.

But what do I know... I've only been coding for a half-century.


p.s. I didn't apply the update. Been around the block long enough to know how that sometimes unfolds.

p.p.s. Sympathy to all who did apply the update and now have a less-than-perfect Rivian experience. This stuff happens, and it'll get fixed.
Just a "me too" post. In the 80s I decided I don't have time to "beta test" firmware updates. I always wait a week or two before I apply any updates to any of my stuff. The only exception to that is high risk, internet facing Zero Day vulnerabilities. I will bite the bullet on those.

And yes, I'm disappointed that there is no roll back capability if an update fails.
 

Killer95Stang

Well-Known Member
First Name
Dan
Joined
Dec 7, 2021
Threads
68
Messages
1,546
Reaction score
3,056
Location
Sunny Socal
Vehicles
Mustang, Falcon, F150, Flex and Explorer
Occupation
Engineer
I do know for a fact Rivian does put upcoming software into in-house and employee vehicles before release to the rest of us. I don't know for how long or any other details about it.
Yes they do. For the previous halloween update, it was released a month prior to the official release to my neighbors personally owned R1T. .42 update has been running on his tester and personal R1Ts for a week.
 

DuoRivians

Well-Known Member
Joined
Dec 30, 2022
Threads
259
Messages
3,839
Reaction score
9,140
Location
California
Vehicles
R1T, R1S
Yes they do. For the previous halloween update, it was released a month prior to my neighbors personally owned R1T. .42 update has been running on his tester and personal R1Ts for a week.
I think the issue is that the production build was signed with a beta internal test certificate.

So, the beta works perfectly on internal Rivian cars, because the key is appropriate

But, Rivian forgot to replace the certificate with production key, so it failed on our vehicles
Sponsored

 
 








Top