PNSQC 2026: Inside Tesla: The Birth of the Software-Defined Vehicle and Quality in the Age of Autonomy

 Well now... that was quick!

We are already at the end of the 2-day conference. Quite a whirlwind experience, and it's neat to see that the last keynote was the first of the PNSQChronicles we did this year.

See the teaser PNSQChronicles video with Florian Rohde

Florian is talking about the idea of the software-defined car, a topic that we have come to see with both interest and annoyance, but that effectively came to be a thing with the advent of Tesla. So what is a software-defined vehicle? It's the idea that, instead of having a vehicle that is limited mechanically, the vehicle is effectively created one time, one version, and the owner/user can choose what capabilities the vehicle provides with how much they have paid and what features they have paid for. In other words, everyone gets a fully loaded car, but how much of the fully loaded car you actually access is up to you and your payment level.

There are a bunch of software components and microcontroller elements inside any Tesla, so what you choose to get and how your vehicle communicates with the broader world can be effectively controlled and optimized for a variety of users. One platform, all sorts of potential configurations and capabilities.

I remember talking about this with Florian in the interview we did and suggested that there was potentially a bit of an annoyance in having to buy/rent features of a vehicle I already own. Florian points out that, in his estimation, this is actually a beneficial arrangement. I remember buying back when I was a starving musician back in 1990 a Ford Escort Pony. This was the most bare-bones entry-level vehicle imaginable. I bought it with no AC, no power steering, no power brakes, manual transmission, crank windows; it didn't even come with a radio (I put that in myself shortly thereafter). I bought this vehicle because it was literally all I could afford at the time (we're talking a vehicle that cost ~$7000 brand new). It was a surprisingly durable vehicle. One of the neat things about an all-manual vehicle is that there's so little on it that could break. I put 168,000 miles on this vehicle in about 6 years, and then I gave it to my brother, who put another 100,000 miles on it. My point is, this was an insanely good value for a vehicle, but I was locked into the choices I could have afforded in 1990. I didn't really mind that, but there were indeed times when I wish it could have done/been more. So what if I could buy that same $7,000 car, but later on, as I got further along in my career, I had an easy way to enable things like power steering, power brakes, turn on the AC, etc. How would I have reacted? Probably favorably, as long as I felt it was a reasonable trade-off for the functionality offered. 

In any event, I want to thqank FLorian for describing this approach that they put together. I'm not a Tesla owner, but as we discussed the details of this talk, I moved over into the "adopt as you need" category. How cool would it be to be able to buy a vehicle that I may only need 2 WD for, but later on I might decide, "Hey, I think I'd want to have 4WD on this vehicle." A very expensive and time-consuming process with any other vehicle, but how cool would it be to be able to just "turn it on?" This is a fast overview of the details of Florian's talk, and I have to say I found it interesting and refreshing to hear about an industry I have zero career involvement in. Am I entirely on board with the "pay-as-you-go" approach of an already loaded vehicle? Not sure, but it makes a lot more sense now :).

PNSQC 2026: "Testing Without Boundaries in the AI Era" w/ Tariq King

Yay! A Tariq talk.

For those not familiar with Tariq King, he's a great speaker, a great innovator, and a fun person to hear speak. The last time I saw Tariq on stage was back in 2024, when he was talking about the capability of generative AI and what it could do at the time. HE was discussing some of the Turing test details regarding human faces and artwork that were generated by AI and what we could tell vs. what we couldn't.

It's been a couple of years since then, and we have now seen some of the outcomes from these Generative AI tools, as well as the blowback and retrenchment of people's opinions on these technologies. It's made an interesting conundrum for me. How do I reconcile the work that I do that may require AI to even be viable vs. the creative industries I am in where Generative AI is absolutely seen as a bridge too far and that, by using Generative AI in the creative spaces of art and in music, you are seen as a "clown show." We weren't there two years ago, and now we are having different conversations than we were then.

This opens up an interesting element of the Generative AI puzzle, even beyond what we are doing, and now discussing when we should or should not use it. We can see that on Spotify, music that has been generated by AI tools is being delisted and forced takedowns applied. I know that's not something that Tariq is necessarily going to address here, but it may be interesting to discuss. If anyone is interested in my take on that, maybe that's a series I can do here.

In my workday world, using AI or being considered for employment requiring my use of AI is not a matter of nuance or delicacy. If I can't demonstrate I know how to use it in both semantic ways as well as autonomous agents working for me, I'm not going to be employed. So in some cases, I may not be able to take some stance and say "AI for thee but not for me". More to the point, AI has given me a desire to be more focused on testing it and trying to figure out specifically what AI is doing, so I can be part of making sure that AI doesn't do the wrong stuff.  

I've been having this conversation with a number of people that I am deeply distrustful of any application I can't reasonably test. In short, I'm not "all in" on AI. I had a funny conversation where I compared AI to the early days of MIDI and how people were hugely dismissive and antagonistic towards using MIDI to make music, especially when it came to sequencing in real time in performances. We don't have those conversations any longer because those MIDI pioneers not only showed how challenging it was but also demonstrated through their creative output that they could actually write music and be inventive in their creations. Will Generative AI get to that point in the music space? On one hand, the music that is being created is polished; it's entertaining, and it's well produced. What it isn't is unique or interesting.  It's a sum total of everything that has come before. Same progressions, same melodies, same structures. And of course it would be. It's been trained on the world of music that's out there. So it can recreate all of that. But what it's not good at doing is breaking the paradigms. It's not good at creating something from the heart. Something human. Something organic. Granted, some people may not care a whole lot about any of that. However, for many of us, to quote the late great Chuck Mosley... "We Care a Lot!"

Back to Tariq's direct points, what do we need to be doing to both test these technologies and determine the future we want to make? One of the fascinating things I came to the conclusion of many years ago was: if I found I could live the rest of my life without working, what would I do? I'll not kid anyone; I'd devote myself and my time to Ensign Red, my band (which, I will be fully transparent and honest, has been how I've been spending the majority of my time since being laid off from my last job ;) ). I also said I'd love to get into snowboard R&D, as at the time I last had that thought experiment, I was a competitive snowboarder (retired since 2005, but it was a great ten years :) ). The third thing I'd want to do is advocate for software quality in any way I could, even if I never got paid another penny to do it. That may be a weirdo thing about me, but it is interesting to think about. So far, I have spent a tremendous amount of time still focusing on software quality even when I'm not actively being paid to do it. The fact is, I love testing, and a part of me has always hoped I'd be able to test forever, or until I shuffled off this mortal coil. Well, I have zero control over who will choose to hire me, but I can advocate anyway, and advocate I will. We are dealing with models and tools that make mistakes, and often pretty fundamental mistakes. 

I like Tariq's thoughts that software testers haven't been taken out of the equation, but that our roles and responsibilities are shifting. We are less needed for our actual physical testing acumen. We are more needed for our judgment and clarity of purpose. To borrow from my comments earlier, MIDI itself doesn't write anything that is new or innovative. That's coming from the mind of the musician. I may have tools that can structure chords and chord progressions, but it's still up to me to know my modes, where I can use them, and how to know when they actually sound good. 

I'm reminded of a comment a dear friend of mine taught me back in the early 1990s, at the start of my testing career (and Chuck, if you by chance are reading this, "hi" and "thank you for everything")... "Every tester, every programmer, every person who works in tech needs to know when they can afford their attitude." That is a statement that has stuck with me over the years. Sometimes we are very valuable, and sometimes the things we think are valuable can be devalued overnight. If we cling too tightly to the technical skills we have,  those can be rendered obsolete quickly. The desire to learn, the desire to explore, and the ability to use those skills to pivot to new realities- that's the valuable skill, and that is the honest, real area where we can see if we can really afford our attitude. 

PNSQC 2026: "Communication Challenges in the Intersection of Diversity, Agility, and Leadership"

I had a lot of fun talking with Dr. Gwen Avington and Diana Larwsen for our PNSQChronicles interview for this talk, so while I can't be in person to experience it, I can at least appreciate a lot of what they are talking about.

PNSQChronicles interview with Dr. Gwen Avington and Diana Larsen

In the talk today, we were presented with an image for a brief period of time and then asked to say what we saw in the picture. As can be guessed, the image was not clear, and there was a lot of interpretation as to what was in the image (as a remote viewer, I had an even fuzzier view of the image, so it was interesting to hear what people in the room saw.

Quality is one of those areas that we talk a mean game about, and we know we should care about it. However, oftentimes our first quality hits (as in the bad kind, not the sensation kind) tend to come about because of poor communication. We don't have a clear understanding of what we should be doing. It doesn't matter who the person in the room is, or what the responsibility is. If we don't have a clear idea of what the problem is that needs to be solved or addressed, we are already at a disadvantage. Communication can absolutely help to mitigate risks and help avoid costs later on because we didn't discuss or understand the issues.

If we have conversations about quality or lack thereof later in the process, we will have to find ways to shoehorn those capabilities or quality measures in at a point when, had we done it earlier, we could have avoided so many issues. This is definitely an issue for newer people. We might feel like we don't have the status or the understanding necessary to speak up in early stages. We often mistake longevity for expertise and knowledge. We may have questions, but we fear being seen as dumb or lacking. Perhaps it behooves us to say, "Hey, I may be new and lacking information, but have we considered 'X' here?" I've had those experiences, and I've learned that it is valuable to have that attitude. Just because someone has experience or longevity doesn't mean they necessarily know if they have considered areas. Even if they have, they may not know that they are not communicating it well.

So how does diversity work into this? Sadly, a lot of the time, there's a set idea of who has expertise and understanding. We make mistakes all the time in this capacity. Everyone brings something of value to the table, and sometimes the best insights may come from people who may not be as obvious. Sexism, racism, classism, and other "isms" can get in the way of who we think may be able to offer insights of value.

We always get down to the question of what we perceive quality to be. One person will have some different ideas compared to another person. We are all used to the idea that "Quality is something of value to some person(s) who matter". That's a part that we often struggle with. We think that we have an idea of what quality is, but we might not be thinking of the areas that are actually important to the people who are most concerned with it. We also need to know when to reinforce and encourage people to show that their input and observations are both important and valued. No one wants to speak up if they think they will be shot down. It takes courage to open up and communicate. Additionally, help foster an environment where they can step up to speak and know that we have the space to speak in the first place.

 

PNSQC 2026: "With Great Judgment Comes Great Great Responsibility" with Paul Grizzaffi

Good morning again. This is one of the reasons I am sad to not be in person at PNSQC. Paul and I go way back, and I always have fun when I hear him speak. We frequently bond over our love of music, especially heavy metal, so Paul, just know that I'd be bending your ear if I were there ;).

How many of us know what a Pyrrhic Victory is? Pyrrhus of Epirus is famous for winning battles with absolutely dreadful losses, so much so that the term "Pyrrhic victory" means a win that comes at such a great cost it's arguable if it was actually worth it.

PNSQChronicles Podcast previewing the details of Paul's talk

AS testers, we are often asked to "do the right thing" (a Spike Lee joint ;) ). For the few of you out there who chuckled, you're my people... I love you :). Automation is something that has a specific purpose. We can argue all day long if that purpose is actually needed or necessary, but for many of us, our jobs would be rendered very difficult without it. We all do some form of automation if we have done something enough times. That's often the first wave of automation, the "Oh my stars! If I have to do this process one more time by hand, I'm going to lose my mind." I'd argue that the people who are least fond of these steps are probably the ones who will embrace and get good at automation the quickest.

In this current age of AI, we have a fresh new danger. AI can write all of the tests and even the test code for us. In truth, it can. However, if we think that we are going to get "one and done" tests that will be resilient, durable, and effective over time, there may be some surprises in your future. In my last gig, I had the experience of doing both roll-your-own automation and working with AI to write the test code and run it. As I was working through those processes, I came to a simple conclusion. The time to have a vetted and confirmed version of automated tests that AI generated vs. tests I created myself... was roughly equal. That's not to say that I'm some amazing automator (I mean, I know some stuff ;) ) and no question, AI can crank out code so much faster than I can. Still, when I question the code and ask why it's doing what it does, the rounds of revisions to get to a truly working and robust version of tests, at the end of the day, were roughly even.

For those who know how I do these, I'm writing this as I'm listening to Paul, but I'm not going to regurgitate his talk. I am going to consider what he is saying and apply it to my own experiences and see what rings true and what I might learn something fresh from. There are absolutely costs associated with using AI, even if it feels like it is cranking stuff out that feels fast, fresh, and amazing. One of the projects I worked on was to take our Documentation as published and make an analysis gap of what tests we had and what options our documentation was saying we did. While I will not claim that's the be-all and end-all of what should be automated, if you want to do an interesting exercise, I recommend doing that process. You can do it all on your own, or you can run it through AI, but either way, it gives you a simple place to start. Do we stop there? Of course not, but at the minimum, you can say that you are making tests that at least cover the areas that you would want to encourage your customers to be doing. Start with the happy paths and then look for the areas that could trip you up. Look for the error code that exists, and then try to create tests that surface all of that error code effectively. Again, whether you do that as a roll-your-own project or you turn over the considerations to Claude Code, OpenAI Codex, or some other AI methodology, ultimately, we want to know what's happening and why.

As a musician, I have many tools that are at my disposal. I use Digital Audio Workstations to do actual recording; I use multiple amp sims and effects that are built into plugins, and I have lots of virtual instruments (even singing voices) so that I can experiment with various things. Some people might remember the early 80s and the advent of MIDI and sequencing software. I remember well the antipathy people had toward MIDI back then, and the feeling that "people were pretending to be musicians" by using MIDI and sequencers. I'd argue that any performer who chose to bring MIDI onstage in those days and orchestrate all of that in a live performance was a braver soul than I. It was easier, in my mind, to just perform than try to wrangle all of that stuff in real time. I remember the snide remarks coming from the metal community especially. The irony is that, a couple of decades later, you would be hard-pressed to hear a metal album produced today that isn't using all of the software recording features that exist today. The beat alignment to the grid and the level of precision that is orchestrated at the point of recording is absurd now. Is it easier than performing it? It might well be. Is there still a performance to be heard there? That's another question entirely. If we are going through and we are massaging every guitar part with quantizing, aligning every beat to the grid, and using Melodyne to clean up every vocal note's tuning, what we end up with may be a pristine recording, an elaborate artifact, but we can't call it a "performance".

To borrow from Jurassic Park, sometimes we get so caught up with what we can do that we might lose sight of what we should do. Knowing when those two options align, and when they don't, is the big thing. I wish I could be there in person to riff with Paul about this, but I hope he enjoys this rambling missive in the meantime :).

PNSQC 2026: The AI Assurance Imperative: Quality Engineering for the Agentic Era w/ Jonathon Wright

Hello everyone, and for those at PNSQC this year, I hope you are having a wonderful time. I, sadly, am not in Portland for the first time in many years, and I am genuinely sad about that. There are reasons I can't be there this year, and I hope that I can participate next time, but for now I am happy and grateful that virtual PNSQC is an option.

Many of you may have seen my PNSQChronicles interviews over the past few months where I've had a chance to talk wth many of the presenters, and Jonathon was a fun interview for me, so I think it's a good bet that you all will enjoy his talk, too.

Jonathon just made a point about the latest series about AI that Netflix has been airing, and pointed out that Sam Altman has said that the most important thing that these companies could be doing is testing. 

At the same time, we are dealing with AI agents that operate independently, generate code, run tests, make choices, and develop systems without human involvement. So how do we actually test stuff like this?

Self driving card, next-gen technology, and everything we are looking at today is aiming for stuff that is wildly different than what we are used to. We are talking about new sciences, ways of using technology that we have not even considered, and many of us are still testing things for the paradigms that currently exist. Nothing wrong with that, but the most value we can add is to actually consider how to test for what comes next.

The Human in the Loop is a common phrase, and something we should all make sure that we advocate for. We cannot let these systems run without some level of human judgment making sense of what's coming out of it. We have the phrase "Agentic" now that we need to embrace. It's a fad; it's an experiment. We've all heard that, right? That's likely not going to be true. We have reached a point where so much stuff is coming out now that there is simply no way that we can keep up with it, much less test it effectively.

So while we have Sam Altman saying the most important thing is testing, why does it feel like actual testing is not being included in this conversation, or if it is, it feels very peripheral? We are currently looking at a situation where seasoned engineers are struggling to find work (raises hand: I'm one of those people at present). Don't get me wrong, I haven't given up hope here, but I am certainly curious as to how we are going to address these situations if literally seasoned programmers and engineers are being pushed out at this stage. So if testing is going to be needed in this Agentic AI age, who's going to do it if we are actively removing people? This seems to be an interesting conundrum. Either AI systems are going to have to learn how to effectively test on their own, or people are going to have to help bridge that gap. Again, it's an interesting question: how much are we willing to give of ourselves to help make AI better able to test itself, and perhaps risk losing our place in being able to be part of that conversation in the first place?

The intriguing part of all of this is wrapping our heads around ways that we as people could be effective in this new world. What methods will we use? What approaches are we going to pioneer that we have not yet had the chance to get a feel for? How much of what we are going to need to test do people actually even understand at this point? I don't say that lightly. To borrow from a favorite quote: "The significant problems of today will not be fixed by the same logic and reasoning that created them." (I'll have to go back and give that proper attribution and wording, but that's how I remember it right now). Jonathon is talking about the idea that we can literally load multiple testers' experiences and approaches into a database and effectively have those testers working for him (including me, if they decided my corpus of test writing is worth anything ;) ). That's an intriguing option to think I could have Angie Jones, Randy Rice, or Matt Heusser at my immediate beck and call because I could create agents that would test based on their writing and principles that they have published to apply to my own tasks. 

This is a wild new world we are playing in now. I don't have a crystal ball, and I can't say what will be happening next year, much less five years. The key Jonathon is trying to point out is that we don't have five years to absorb this. This is a reality we are going to have to embrace really quickly, and we ignore it at our peril. It's proving to be an expensive option for many, but don't assume that means that it's going to just fall apart. AI is here, enmeshed, and not going away. Testing it is going to be critical to it not running off the rails. I'm glad to see some people are actually considering the testing needs and realizing the elephant in the room. How we go about doing it is anyone's guess.

CAST 2026: "Accessibility, Automated Testing and AI - A Reality Check" with Chad Hester

This is a neat situation. We will have, effectively, back-to-back A11y talks. I'm giving a talk on Accessibility after lunch, mainly on how to focus on Accessibility with the entire software development life cycle. My goal is to give new information and, even more critically, NOT repeat too much of what the other talk is all about, so to that effect, I am here to both learn and filter my own presentation ;). 

Enough about me; the rest of this will be about Chad Hester, our presenter, and his talk about "Accessibility, Automated Testing and AI - a Reality Check".

There are many ways that we can say that we are "automating" accessibility testing. The nice thing about web accessibility especially is that there is a built-in vocabulary that expresses accessibility compliance. It's not always clear-cut or obvious, but some tags and attributes exist specifically in HTML to pinpoint and determine if accessibility features are being handled (or not). There's an entire framework for this (WCAG), and if you reference certain areas in the WCAG spec, you can determine if something is present. If it is, hey, compliant. If not, hey, we need to do something about that.

So to that effect, yes, Accessibility can be and is being automated. You can do it for free with the axe-core library (axe-core is created by Deque Systems). axe-core lets you call the library, read the web page elements, and based on what's there, it can tell you what is not compliant. It's a big hammer, but it can drive big nails. It can be finessed with extra code to get to individual items, too. I'm seeing something new this go around: BarrierBreak a11yInspect, so I want to see what that is. 

When “0 issues found” doesn’t mean accessible

I really appreciate Chad bringing this up early in the talk. Another thing to realize is that you can have a 100% compliant application, but it's miserable to use for everyone. Yes, everyone can use it, but how it's implemented may be truly sub-optimal. Automation will not tell you that. Humans need to make that judgement call. Automation can help find non-compliance, yes, but it can't tell you if your compliance is actually good or helpful.

WCAG is Ever Evolving

Often we look at WCAG as being definitive (think of it as the IEEE for accessibility features), but it's always evolving. To be most effective, we need to be aware of what version we want to be focusing our efforts on. WCAG 2.2 is the latest and greatest published version (as of 2023), but WCAG 3.0 has been under development and consideration for 10 years. Lots of cool things in it, but it's not authoritative or definitive, and things can and do change. It's a fun playground, and you can check out a variety of things, but if you want to be seen as doing the latest and greatest that's production valid, stick with WCAG 2.1.

Is AI an A11y?

Chad shared some examples of where AI was able to add value and what aspects they excel at. The WCAG rules, that's a no-brainer. Feed it the WCAG standard, and it can tell you if your code is compliant or not. That's a neat value add, don't get me wrong, but axe-core can do that for you too, with zero AI. My favorite statement, including when it comes to automation and AI, is "Tools Help, People Decide". AI in Accessibility will help with the mechanics, but it is no closer to making a true judgment call than automation by itself is.

Hello From Cocoa Beach: CAST 2026 is Underway: "How Avoiding Conflict Is Breaking Your Team"

 This is going to be an interesting and different CAST this go around. While I have live blogged conferences for years, I will not be doing much of that this go-around. That is because I am going to be doing live webcasting and video casting. We are launching a Webcast called "Responsive Ilities", we being me and Justin Bench. I will be posting the links to those as they go live. They will be fast clips, fun interactions, and we hope a good representation of the fun we are having here.

There will, of course, be some sessions we will not be vidcasting, such as our morning keynote right now. We are starting the conference with Dr. Jen Fry and her talk, "The Bugs Aren’t the Problem: How Avoiding Conflict Is Breaking Your Team"

The key message here is, "Software teams don’t struggle because they lack tools, frameworks, or technical skill. They struggle because the conversations that should happen… don’t."

I know this to be true, in some capacity, for every job I have ever had, both in my testing life and in the other things I do. I'm the enthusiastic, bubbly dude who likes doing, likes getting cool things done, and if there are conflicts or issues, we just let them roll off, and we figure we will just muscle through with our enthusiasm, and if we just kick enough butt, those issues will just disappear.

"Stop me, oh oh oh stop me.... stop me if you think that you've heard this one before!"

As you all know, I tend to riff on the ideas I'm hearing. I don't summarize the talk; I think through their points, and I take what I'm hearing and think through it with my own experiences.

I am intimately familiar with seeing something that I think might be wrong, but I'm unsure. Or I might want to make sure I can articulate everything before I vocalize my concerns.  Where does that come from? It comes from voicing concerns too early in the past, or thinking something is wrong but not having a full picture. What's the root problem here? I have an anxiety of looking like I don't know what I'm doing. Ever heard the phrase (paraphrased), "If you sit silently, you may be seen as a fool, but you can say what you are thinking and remove all doubt!" Yes, that's real. We all do that to a certain degree. We fear being seen as foolish or unwise, so the easiest tactic is to hold our thoughts until we are really sure. Maybe, possibly, we will gather what we need to make sure we have a thorough understanding and can present everything brilliantly. More often than not, though, life comes at you fast, and you are onto something else. Then when the problem rears its head, and others see it, you sit there thinking, "oooh, I knew that was an issue, but I didn't say anything because I didn't want to look stupid." Well, now the problem is out in the open, and I look more stupid because I held my peace until I was sure. 

Okay, so how can we counteract this very real issue people face? Part of it is practicing these words (again, this is how I handle this, or at least try to).

"I'm not fully sure I have a handle on this, but I'm noticing something that concerns me about [key area]."

"I may be missing something, but are you seeing an issue with [component]?"

"Are you familiar with this [area of misunderstanding] because I think I may have an issue... but again, I'm not sure."

Am I risking being seen as a fool right now? Absolutely. I'm sharing the fact that I'm "ignorant". Understand, that's a loaded word for many, and we hate hearing it about ourselves. Truth is, everyone is ignorant about a lot of things. Ignorance comes from Latin "ignorantia" and "ignorare", meaning "not to know" or "to be unacquainted with". I try to remind myself that "ignorance" is easily solved. I can learn, I can ask, and I can be taught. 

From a different place, I am often seen as the "psychic glue" in a group. That's a phrase a guitar player in one of my previous bands coined for me. He said that I had a tendency, due to my enthusiasm and general overall good nature (I think the phrase now would be termed 'Golden Retriever Energy' (GRE), a phrase that I actually love :) ), I make it possible for people who would struggle to interact a buffer, so that I cam the person in between who, because of my GRE, I can be that central glue point so we can all work together. Conflict doesn't stick to me or affect me when it's other people's conflict. If other people have issues with each other, I can be the go-between and easily smooth that challenge. The problem with GRE is that when the conflict comes to us, we can internalize it and think we are the problem. So we strive to make others happy and be cheerful, to hopefully cause the conflict to dissipate. I'm good at soothing issues. I'm not so good at actually resolving the conflict. The funny thing is that sometimes, my enthusiasm can have me jumping the gun at certain things, and then I get yelled at... but if people are yelling at me, they aren't yelling at each other. Since I have GRE, I can take having people be annoyed with me, and I can laugh or shrug it off easily. Net result: I glue everyone else together, and we function well,,, but you see the problem, right? Being psychic glue can be a good thing when it's applied correctly, but glue can also be messy if it's not applied correctly. Thus, I need to be willing to step back and speak more openly about the conflicts and be willing to not be seen as the happy-go-lucky golden retriever. I may not be able to be that glue at the moment, but I may be able to be the glue that is needed later on.

That's a great start. It's good to be back. Did you miss me :)?

Breaking the Cycle: Leading Organizations That Thrive Amid Constant Change with Allan Rennebo Jepsen (a PNSQC Live BLog)

Well, that was fast! We have reached the end of the conference with our final keynote. There has been a lot to absorb and learn over the past few days, and I've enjoyed my time here. With that, here's the closing talk for PNSQC 2025.

Allan Rennebo Jepsen is a leadership expert and author based in Copenhagen, Denmark, who has spent over two decades helping organizations adapt to change rather than fighting it. Allan opened up with an example of an online banking initiative that went horribly wrong, where everything that could go wrong did, to the point where the CEO at a corporate meeting said that a large majority of customers of the bank would not be around a year from now. Meaning their business model was cratering and they risked going out of business. Change is needed, but how in the world are they going to do it? Large banks are optimized for compliance, and because of that, they are literally designed to preserve the status quo. 

PNSQChronicles: Leading Organizations That Thrive Amid Constant Change with Allan Rennebo Jepsen

So what ends up happening? “We are trapped in a loop of meetings, updates, and alignment sessions, with initiatives and plans made, but somehow, progress keeps slipping away.” 

This ongoing “cycle of coordination” eats up energy and time while creating an illusion of progress. Wouldn't it be nice to be able to break the cycle and replace it with focused, adaptive, and empowered teams with goals and efforts that can actually move the organization forward?

As Allen points out, the one true constant is change, and change is not slowing down. New technologies, shifting customer expectations, and global competition mean that businesses must evolve faster than ever before. “Success today requires a new paradigm, one that values bold leadership over small tweaks.”

Many organizations instead fall into reactive patterns and mindsets. They organize based on what the business thinks is important, rather than looking at what the actual customers need. Every new change triggers a cascade of alignment meetings, but before that alignment solidifies, another change hits. The result is paralysis through coordination.

What will it take to break out of this vicious cycle? Genuine adaptability, that's what. Organizations that show that they can learn, adjust, and act decisively in uncertain conditions are the ones that will ultimately thrive.

What do we need to do to actually make change happen?

Strategic Prioritization

We need to focus our energy where it matters most. Not every initiative deserves attention. Leaders need to be ruthless in prioritizing efforts that drive real impact and cut through the noise of constant change.

Winning Together

Too many departments chase local wins at the expense of the organization’s overall success. Instead, focus on organizational collaboration and allow for genuine long-term thinking. Optimizing one team while degrading the system as a whole is counterproductive.

Thriving Amid Change

When teams are empowered to make decisions and take action without waiting for endless approvals, they can develop true adaptability. With those experiences, the team can get better and address challenges related to change. Success likelihood grows when teams have both the authority and the accountability to act quickly. Resilience and adaptability are learned competencies, not traits reserved for a few innovative companies. If you want to be resilient and adaptive, you need to practice and work towards being resilient and adaptive.

Allan encourages creating a “low-risk, high-impact” framework for building organizations that are genuinely adaptable. Continuous learning loops, clear ownership, and a culture of shared goals help with and reinforce the opportunities to effectively adapt to change.

As Allen points out, “These organizations didn’t get there by accident. They created the conditions where adaptability could flourish.”

Artificial intelligence, decentralized decision-making, and global competition are reshaping how organizations operate. Instead of fearing disruption, leaders should view it as a constant condition to master. Focus on adaptability as the ultimate organizational competency.

“You can’t predict the next disruption, but you can prepare your organization to handle whatever comes next.”

Key Takeaways

- Prioritize what truly matters. Avoid being spread thin across too many initiatives.

- Empower your teams. Give them the clarity and authority to act.

- Collaborate across silos. Success comes from shared goals, not isolated wins.

- Embrace continuous learning. Every challenge is a chance to adapt and improve.

If there's any one message or idea to bring home today, it is that change doesn’t have to be chaotic. Leaders who build adaptable, empowered teams will be the ones who turn constant change into a competitive advantage.

Want to know more? Allan’s book “Impactful Organizations – And How to Become One!" expands on many of the ideas shared today. 

RAG to the Rescue: Reimagining Enterprise Unit Test Management with AI (a PNSQC live blog)

There is an entire paper with a lot of great information behind this session, so rather than try to recap all of that, I actively encourage all to Read the paper (PDF). Additionally, this paper is a joint effort with Gaurav Rathor, Ajay Chandrakant Bhosle, and Nikhil Y Joshi. With that out of the way...

RAG is a practical framework that blends Retrieval Augmented Generation into the Model Context Protocol to help generate and manage unit tests in large enterprises. Test creation, governance, auditability, and measurable business impact are key components considered by this approach. Again, there's a lot to dissect here, so check out the paper specifically for details.

Unit testing in big organizations is challenging, no question. Legacy code, multiple frameworks, technical debt, uncertain code coverage, and long fix times are all issues that may of us are familiar with. The authors suggest using AI to assist with test generation as well las test management.

Neat. So how would that work?

The proposal consists of four major parts that work together as a microservice.

• AI Agents interpret intent, plan steps, use memory, and invoke tools. They orchestrate the workflow rather than directly hitting data stores.
• Model Context Protocol acts as a secure, typed gateway between agents and external systems. Think of it as a translator and auditor that controls what context reaches the model.
• RAG Knowledge Layer retrieves code, prior tests, specs, domain docs, and compliance rules from a vector database to ground prompts in the organization’s reality.
• LLM Generator builds unit tests from that curated context, returning deployable test classes to clients.

Given a request to create tests for a class, the agent pulls the file and metadata, queries the vector database by package and class, and retrieves related classes, utility code, mocks, example tests, and notes. That bundle becomes a structured prompt, delivered to the LLM through MCP. The output is a test class that aligns with domain logic and existing patterns.

The pilot for this  system was aimed towards a specific and critical micocroservice. The team accomplished automated unit test generation, which created many quick coverage wins, and also helped track time saved and defect trends discovered.

According to Gaurav, ROI modeling compared manual test creation to be about four hours per case. With this new RAG driven approach, they were able to cut this time down to about one hour, including review. 

Again, there is a lot to take in from these examples and I encourage checking out the paper (linked above) for the specifics.

The Ethics of Quality with Gwen Iarussi (a PNSQC Live Blog)

I'm back. I spent the morning moderating the Management, Leadership & People track, so I wasn't able to do that and live blog like I normaly do but let's suffice it to say that Sophia McKeever (Quality With Hearts Aligned - Bolstering Your Quality with Emotional Intelligence), Heather Wilcox (Is the 'Iron Triangle' Dead?) and Kristine O'Connor (Quality Intelligence: Embedding Customer Voice to Drive Agile Excellence) all did great jobs and if you get a chance to see their talks, do so :).

For the first session this afternoon, I get to see long time friend (and actual hirer of my consulting services during my stint in the wilderness) Gwen Iarussi discuss The Ethics of Quality

PNSQChronicles: The Ethics of Quality & Quality as a Living System with Gwen Iarussi

A great quote to start out this conversation is, "Your scientists were so preoccupied with whether or not they could, they didn't stop to think if they should." (Dr. Ian Malcolm, Jurassic Park).  You may well remember this line and it is just as valid a warning about unchecked innovation. It's not enough to ensure a product "works". Additionally, we have a continued need to advocate for not just that something works, but that it works appropriately. We don't have the luxury of testing blindly and ignoring the possible impacts of our work and efforts. 

I remember back in the days of my Cisco Systems work life that the NetFlow protocol tracking software was developed. I was on the team that was ultimately codifying the "call record" or any and all internet data. I remember part of me was a little leery about what we were doing but I recall being told by one of the developers that, "if we don't develop this with our approach and methodology and ethics, then our competition will create it, and we will have no control over the ethics that they choose (or do not choose) to use."We can argue whether or not that was a good idea (we do of course have end to end tracking of all network data but we also have the ability to encrypt that data as well, so yin/yang, I guess ;) ).

My point with that last example may be seen as trivial today but part of me genuinely wondered if our efforts were being done in the appropriate place. At that time, I was young and unsure of my voice, so I just rolled with it. Today me would be less likely to do that, I'd want to ask a number of questions. Granted, I may not have been able to have modified or altered any of the outcomes, but I certainly would have been more direct and focused with my interactions and questions. I would have advocated for positions I felt we should represent.

Our tech environment today is getting even more fragmented and over the top. Speed of execution is taking precedence over the quality and ethics of what we are creating. We have all sorts of areas where the haves are taking advantage of the have nots through these systems, and it's very much by design. Let's not forget the fact that this age of AI and fast, ubiquitous tech is consuming land, fuel and water resources at an alarming rate. Much of the tech advances and buildout to host and serve it is not sustainable in the long term. At least not if we want to make sure that people have access to water, fuel, and food a few years from now.

Much of this comes down to accountability. How do we develop accountability and stand for what we want to see happen in our environments? How do we make our ethics more than just platitudes? By us building a culture of accountability, we are able to foster a culture of ethics and making considerations that go beyond merely speed and efficiency.

Ultimately, this all comes down to a quote that is attributed to Sitting Bull, "Let us put our minds together and see what life we can make for our children". Ultimately, every good or bad decision we make may have an effect on us, but they will surely and certainly effect future generations. With this isn mind, I would absolutely say it would be in our best interests, including business interests, to be able to leave to our children a world and systems that have effective safeguards to prevent our actively destroying our environment, whatever and wherever those may be.