Podcasts›Visions: A Machine Vision and Automation Solutions Podcast›Drones That See: Inside Modern Drone Vision SystemsLike💬 Be the first to comment →AudioAugust 25, 2026Drones That See: Inside Modern Drone Vision SystemsFrom Visions: A Machine Vision and Automation Solutions Podcast, hosted by Sharon Spielman and Jim TatumHylio CEO Arthur Erickson on cameras, sensor fusion, and onboard AI in modern drone vision systems.Play episodeSaveOpen the audio file TranscriptTranscript from the show's feedSearch the transcript0:02Well, hello and welcome to Visions, a machine vision and automation solutions podcast. I'm your host, Jim Tatum, Senior Editor of Vision Systems Design, and Visions is an Endeavor business media production from your friends at Vision Systems Design. Here you'll find the latest on everything from end-user machine vision solutions to trends, developments, and perspectives on all things machine vision and imaging. Whether you've been working in the industry for a while, or you're just starting to take a closer look at it, this podcast is designed to grow your knowledge and bring greater focus to your understanding of the imaging and machine vision industry.0:39And now, onto our show. Well, hi, everybody, and welcome to Visions. Today, we're going to take a deeper dive into how advances in cameras, sensor fusion, edge computing, and AI are making drone vision systems more capable across a wide range of applications. In fact, recently, VSD's head of content, Sharon Spielman, had a terrific conversation about some of these very issues with Arthur Erickson, who's CEO and co-founder of Hylio, a Texas-based company that specializes in drone technologies and applications.1:14Let's give a listen to what they had to say. Welcome. Today we're looking at drone vision systems, an area where advances in machine vision, sensor integration, and real-time image processing are changing how drones serve the critical roles in a range of industries and applications, including emergency response and security. For our vision systems design audience, the challenges go beyond just adding cameras, success hinges on optimizing sensor performance, flight stability, and manufacturing precision to deliver real-time, actionable, visual data in challenging environments.1:51As automation and AI-driven machine vision advance, these systems are becoming more robust, adaptable, and capable of learning on the fly. Joining us today is Arthur Erickson, CEO and co-founder at Hylio, to share his insights on the technical evolution of drone vision, from sensor technology and payload design to AI-driven processing, and what it means for advancing situational awareness in the field. Thank you for joining us today. Thank you for having me. You bet. First, why don't you tell me a little bit about yourself, your background in the drone market?2:25Sure. Well, it's nothing too exciting. I won't harp on too much about myself. I went and studied aerospace engineering at UT Austin, so University of Texas in Austin. And that's actually where I started the company with three other fellow UT alum. So it's a Longhorn company, classic Longhorn startup dorm room type of story. But yeah, it was through my curriculum as an aerospace engineer, undergrad only, that I first got into drones. And basically for our capstone project, for example, that entire year, it was design a drone from scratch.2:56In this case, it was a fixed wing platform, so plane style design. We were working with the Austin Fire Department to do a simulated mission in which we'd locate a target and then drop an aid package, right? A simulated aid package on that target. And that was how we were graded. So it was kind of a combination of those technical skills I picked up in school and then just entrepreneurial spirit. And, of course, my great team put that all together. And then we started Hylio. It'll be 12 years in January. So all the way back in 2015, again, while I was still in school. So that's where we come from. Since then, primarily, we have focused on the agriculture industry.3:30So meaning that we design and build and sell drones that are more or less replacing traditional crop dusting methods. That's airplanes and helicopters, but I should also mention that's applications done by tractor or self-propelled ground rig as well. So we're offering a more precise, environmentally friendly, better for your wallet, better for the neighbor's wallet solution. So that's typically what we do. But to swing back to this conversation a bit, as a company's grown in size, we've become more successful, had more engineers on staff, had more mature products that we could bring to bear.4:03We've branched out to other industries such as emergency response. So a bit what we're talking about here with the wildfire detection and suppression and other things along that vein as well. Great. Yeah, so 12 years. So I imagine that you've seen quite a bit of change. So from a machine vision integration perspective, what key advancements have you seen in drone vision systems recently? Probably one of the main it's not maybe super exciting but one of the main things is just unit cost right so bringing the unit cost of relatively high resolution cameras down and making them lightweight as the drone industry explodes making them, cheaper it's just obviously going to be a force for more use out in the field so i think personally a lot of that has come from the EV market right so basically all these cars now obviously auto is a massive industry as they've integrated more digital vision systems.4:59We've, as a drone industry, reaped those benefits. Camera technology as well, right? So every cell phone has a camera. So yeah, I think just price point is a big one there. So just packing more punch in a smaller and cheaper package. And then on the AI side or on the compute side, edge compute as a concept and instantiated in more efficient, again, cheaper, but more efficient edge processing power is key, of course, to actually having these practically come into play in a scenario that's very time sensitive, such as emergency response, right? So you can't be deeming stuff back to the cloud, waiting 24 hours to have some server do it, and then acting on the information.5:33It's got to be done right there in the field. Right. So let's talk about the types of cameras and sensors that are incorporated to optimize the image capture across those harsh operational environments that you're talking about. Yeah, so it really depends. If we're talking about something like identifying a fire in a wildfire scenario, you don't actually need that much vision to, you don't need that much resolution, I should say.6:05It doesn't have to be like a high fidelity feed that you're reading because a fire is pretty obvious, right? So especially if you have a thermal sensitive sensor, a fire is pretty dang different than its surroundings. So in a case like that, it's fairly black and white. You don't need a super high-powered thermal sensor, or you probably don't even need thermal in general. You could get away with RGB. So that's pretty easy. But in a scenario like if you go to our traditional industry, which is, again, precision agriculture, you, again, depending on your context, might need some pretty high-resolution camera work to be able to identify a somewhat different-looking green thing versus another green thing, right?6:42So the plant you want to save versus the plant you want to kill, like a weed. So typically, I mean, to ground it, most of our customers like on our sensing platform we have, which we call the Photon, a lot of the customers are going with a 4K on 20 megapixel RGB sensor with optical zoom up to 5 to 7x. And this is typically good enough for them to be pretty speedy with some crop scans where you can fly at 300 to 400 feet above the crop and identify literal. Individual weeds or individual leaves even on plants.7:16You could see stuff like fungal outbreaks, little white spots or black spots, for example, on the leaves of corn or something to that nature. So it really comes down to, again, your use case and like what you need your ground sampling distance to be. But people are operating anywhere from half a centimeter per pixel to two or three centimeters per pixel based, again, on ultimate use case. Right. So how do the drone vision systems, deal with the varying lighting conditions and the weather interference and the motion blurring to maintain the image fidelity for the downstream processing?7:54How do you select, how do you specify that for your drones? Again, this is like designing your system. Not to go on a tangent here, but like our Photon, which I had just mentioned, is designed intentionally to be very easy for you to swap payloads out, right? So you can get really any third-party sensor, like a Sony ILX. You know, it's basically like their DSLR, but shrunk a little bit. And then you can stick it on for like a drone. You could use like multi-spectral or hyper-spectral cameras, thermals. You could put lidars on there which i know it's not a camera but or a vision system but i mean you could put anything on there right because it's going to change so like our typical camera that we would sell to an agricultural customer would be somewhat of a one size fits all right so like, decent at least like HD so 1080 you know video streaming capabilities but if they're not using it for precise weed id, just like a navigational tool that's all they need hdr right so it can actually perform really well in low light settings but it's not true night vision right so we do have some customers that actually,8:55Strictly operate at night or need to operate at night for some application whether that be ag or something else and in which case you know they would we'd have a straight up thermal based system or infrared near infrared perhaps and we'd have an illuminator coupled with the sensor so you're illuminating it and then receiving that data back so it. That sorry to give you a bad answer but just like it really we do all sorts stuff based on the customer. So we can integrate by design. It's a very extensible system. So if they need night vision, we can do that. If they need thermal, we can do that.9:25If they need high resolution RGB, we could do that. Okay. So in terms of the processing architecture, what onboard compute AI capabilities enable real-time interpretation of visual data? Is that that photon that you're talking about for obstacle detection and terrain mapping. And then that also kind of makes me think about, I know you said you cover ag, you cover emergency services, and I believe surveillance do cover, aerospace and defense.9:58I know you were starting out with agriculture, but are you branching out into all of the industries or can we talk about that a little bit? Yeah. So we are basically doing all of the above. We view our drones as a platform technology. And so not to belabor it, but what I was just getting at, we make it very easy for any third-party provider or company to put sensors or modules onto it. So ag is one thing, but yeah when you talk to the and i keep bringing up the fire people but like it's just something that's top of mind because we're doing that right now but fire suppression people or the police department, right they're going to have like in the case of fire you might need to drop a flaming tennis ball essentially and this is to do a controlled burn or you might need to spray out a special compound that like literally like directly suppresses the fire the police might have even something like a loudspeaker on the drill which is just a different thing to do crowd control right to speak to crowd like you know disperse disperse perhaps like a tear gas canister right that's something we haven't done yet but we're in conversations about so things of that nature i mean there's all11:00Sorts of different things you can stick on these things. Bringing it back though it's just, yeah can you build base that's like 80 there and just like the french fries that go with the hamburger are like relatively easy and maybe like you know a few weeks worth of integration work for our team and then the customer's team to actually implement so that's kind of what we see generally for a lot of these enterprise-level customer interactions right now is like a little bit, mostly like the stock unit we sell, and then like a little bit of customization on top.11:31Okay. So why don't you talk a little bit about that? So the payload design, the weight distribution, and the vibration damping, how do all those impact the optical sensor performance and flight stability, in the drones themselves? I mean, because, you know, a speaker as opposed to having to carry fire suppression are very different. Yeah, no, that's a good point. Yeah. Yeah, I should elaborate more on your last question about kind of how we do some of the processing, but it's a very fair point that vibrations are the enemy of clear visual data.12:04You have to solve that first mechanically, of course. So we've designed a brushless motor, actuated three-axis gimbals, and that's typically what our cameras are mounted on our drone platform. So that gives you control where the camera is pointing while you're flying, but it is actively stabilizing the camera feed the entire time. That to get a little bit even nittier, grittier about it, like you've got this gimbal, but it itself is mounted on vibration dampening structures, right? Rubber type structures that are placed in such a way through analysis we've done and testing to really minimize that vibration even further, even beyond that, you still have vibration.12:40So then you apply like a digital stabilization layer, which there's a fair amount of open source tools out there that we play around with and stuff that we've developed in-house as well. So that's like edge detection. And, you know, we'll get into it. But the basic things that camera companies are applying to stabilize moving frames, we're not doing anything like we're not a camera company at the end of the day. Right. So we're not doing anything bleeding edge or anything in that regard. But really just trying to cross our T's and dot our I's and make sure that you mechanically eliminate the vibrations as much as possible.13:13Do as little digital stabilization as you can, because ultimately, obviously, that's going to lead to artifacts and stuff like that that you don't want if you do too much digital correcting. So we try to do it the right way mechanically. What we employ, object recognition and whatnot, is a variety of things. Again, a lot of it is leveraging open source stuff out there like YOLO, machine learning, detection libraries. So it's like basic stuff like, can you identify a human versus a cow versus a car? There's a lot of stuff out there that's available to everybody already for that.13:46But it really comes down to using the right tools or algorithms for the right problem and designing the software in the interface in such a way where the customer or the operator could switch between the stuff when needed, right? So, yeah, you might use a different model when you're doing detection of a car or a person, you know, maybe in a law enforcement sense versus the model you use, of course, for identifying what we call volunteer cotton in a cornfield or vice versa or Johnson grass in a cornfield. So it's more of like an interface thing. These tools all exist under the hood, of course, but can you seamlessly switch between them and give like the customer that power without overcomplicating it to use the right model at the right time?14:26So how do you go about when you're sitting down with your customers? Are you selecting off the shelf? Are you using customized components? How does that work? And I'm speaking specifically for the vision systems on the drone. I don't know how. I guess I'm kind of looking when you're doing your drones, when you're making them, i would imagine, you have your own components that you're putting together for the drone itself but then you're going to a third party for the vision systems is that yeah that's that's usually right at least for now we are actually developing like from the board level up like our own camera but even then i mean of course you're still buying the sensor from Sony or whomever so like usually, like right there's a company we utilize called e-con Systems they're actually based in India Yeah, but they make great products.15:18A lot of them are designed for drones. To our points earlier, they're cheap, they're lightweight, good stabilization, etc. So we use their cameras, but we build a gimbal around it. And then we have an onboard compute. Typically, we're using like Jetson or in Nanos right now. So little computer, NVIDIA powered, of course. And this is doing a lot of this post-processing we're talking about in real time. So segmentation or just a obstacle detection or object detection, target detection, and then spitting whatever's needed into the flight controls, which are they going to turn that into like an actionable maneuverer?15:54And you're providing the hardware and the software to your customers? Yes, that's correct. So we are full stack in that sense, which not a lot of people do what we do, I should say. There's a lot of companies out there that outsource the software or vice versa, outsource the hardware. Drones, it's an orchestra, right? It's all these things working in perfect harmony. And we've just found, because we've done a mix of both, right? When we were a younger company, just four kids out of UT Austin, there was a lot of system integrating we had to do. Where we were going out and buying hardware that we didn't design, trying to make it work.16:27But ultimately, there's a lot of limitations there, especially at the edges. But eventually for the entire system, like you're looking at some pretty serious inefficiencies or sometimes a downright inability to do a desired outcome because you ultimately didn't control that supply chain, that, you know, the entire design of the system. So again, with the orchestra that is a drone, we think it's imperative that you do both the hardware and the software for ultimate outcomes. So, speaking of the orchestra, then the listener of the orchestra, which would be the people who buy the drones, are there any vetting processes?17:00Okay, so can you talk a little bit about sensor fusion and how it is evolving in these systems to improve the situational intelligence accuracy and the robustness? Yeah, that's pretty important. When the drone is flying, I mean, this is especially important for obstacle detection and avoidance. These drones, like in the agriculture context, are often flying quite fast, 40 miles per hour. They're flying low. So yes, they're flying over depopulated cornfields. So it's not really a risk to humans, but the drone is at risk because it's flying low, fast, and there's trees and there's guide wires and whatnot.17:36So you need a pretty robust vision system. So it's got to be able to actually see everything. And it's quite a noisy environment in terms of obstacles that these systems are detecting, right? Because you have all this vegetation. Again, you have all these trees, power lines, whatever. You need to identify everything, even as small as a half-inch power line. You need to identify everything, but then you need to compute on board to say, is that actually something I need to worry about, right? And throw away the stuff that is just noise, like actual noise. Also ignore the stuff that is a real obstacle but is it in your path for example so you're doing all this like calculation on board in real time what's the heading of the drone what's the speed where are these obstacles in you know proportion to my heading or.18:18In relation to my heading i should say and so it takes a lot and like to bring it back to your point about sensor fusion, like there's no single sensor that does everything perfectly right and so for example i'll ground it again we use radars a lot for obstacle detection, because they're a pretty good overall fit because in the ag drone world you're spraying products so there's a lot of moisture in the air like mist and fog and there's sunlight reflecting off this moisture there's dust that you're kicking up so all these things radar can relatively easily penetrate through and give you still a pretty good picture of what's on the other side but versus like a camera which might be obscured by dust or, or liquid or a lidar system which would just bounce off the first thing it sees.19:02So you have to play this, compromise game with what's the best fit for most of the situations or, what you can do is what we're starting to do now which is like it's going to increase the cost a bit but add more more different sensors and fuse them together so then you are actually truly covering like all the bases right so i i think the big push for us right now is okay we have radars which i just mentioned we're trying to incorporate, binocular vision not as, you know replacement to the radars in conjunction again along the theme of fusing it because what the binocular vision could do better than a radar is make let's say.19:39More practical planned decisions or help you make more practical plan decisions with how to go around an obstacle so proactively avoiding like a tree line or something versus a radar which just sees it and then you're you're reacting to it and and kind of losing a lot of energy there right and, you know seeing the tree line stopping and then doing a bit of a Roomba approach and getting around it, right, versus where you could see it like a human would with binocular vision, say, okay, I can kind of see the way around it and then start getting that way. Yeah, that's where it gives you more benefit. But yeah, sorry, that was kind of a meandering answer.20:12No, that was good. Maybe you could talk about some of the system integration challenges that you face when combining the cutting-edge vision hardware with the drone flight control and communication modules? Yeah, I think this is like a mostly a compute challenge, as in you only have so much compute. So a lot of these sensors are more than enough in terms of data. Like, you know, you could be pulling gigabytes basically off these things per flight, if not more. So, yeah, you're getting plenty of information. The challenge is for the engineering team is, yeah, to what we were discussing earlier, what do you throw away?20:50Like, what do you use that limited compute for that drone every cramp counts, right? So you can't just have a giant server rack of processing power on this thing. You have to have, you know, tiny little jets in, which is good, but it's small. So just deciding, doing the triage of deciding what's the right information to actually store and compute is the challenge there. It's like a budgetary problem almost. So do you have, does the software that you provide the customers, does it have, say, selection boxes. Of what is needed for each particular application so that they cannot be wasting, data collection because it's not going to do anything with that data anyway?21:31So how does that selection happen? You know, we don't really have a lot of that yet, but that is in the works. You would have, Like I dropped that menu in our software to your point and it would be, okay, here's the model that's best for identifying humans. Here's the one for they use for plants, et cetera, et cetera. Of course, we'd want to also expose camera settings to people. So like, you know, what is your, your data rate? You know, are you limiting the resolution or whatever, if it's a software defined camera system. So I just try to give the customer more customization without overwhelming them.22:03Right. Cause most of these operators aren't like these camera vision nerds. Right. So they need to be explained to things in outcome type of language, like see human, see plant, see whatever. That's what I was just going to say. That's honestly what I was just going to say. If you ask somebody what data rate do you need, do you also tell them if you're looking for a plant, you'll need this? If you're looking for a human, you'll need this. If you're looking for a fire, you'll need this. Exactly. I mean, we're going to hide that behind these buttons that are doing that crunching on the back end.22:36I mean, there's going to be like a pro selection menu where it's like, okay, like you can tweak anything you want. We don't guarantee functionality, right? So that for the power users. But generally for most users, it's going to be, again, driven by function. And so we'll do all the setting tweaking under the hood. Gotcha. Okay. So looking ahead, how do you see advances in AI image processing algorithms and new sensor modalities influencing the next generation of drone vision systems for OEMs and integrators and machine vision industries.23:08I'm just thinking of your 12 years that you have in this industry, maybe looking at crystal ball for the next 12. But yeah, so I guess I'll leave with a bit of a hot take. I think AI is, of course, being overused. I think that's obvious to everybody for a lot of things that it doesn't need to be used for. It's not going to change in the drone world either. So you've already seen this over the years, but even more so now, you're going to see companies trying to apply AI and relatively expensive in terms of compute models and whatnot to do very mundane tasks that could be solved with simple linear regression data analysis principles, right?23:44So not AI at all, but just basically input-output, you know, formulaic stuff. So I think you're going to see a lot of overuse of AI, which is going to be really computationally expensive and inefficient. And therefore the ultimate product that these various companies hypothetically are selling is not going to work that well because, again, it's a budget. It's a triage problem. If you're not blowing all of your compute on like relatively dumb use of AI, you're not going to have anything left over and you're not going to be a very effective product. So you're going to see this big boom of these companies promising the world with AI models on their drones.24:17They're not going to do that much. Then there's going to be some sort of contraction or consolidation or whatever you want to call it about how they use AI are going to rise to the top. And hopefully we're the latter, but like we're humble. And of course, we're learning stuff every day. So we'll try to be better, just introspect on that. Terrific. Well, I can't thank you enough for spending a little bit of time with us today, Arthur. Thanks again. Until next time, this is Sharon Spielman with Vision Systems Designed. Stay curious. Well, that's a wrap for this episode of Visions, produced by Endeavor Business Media, a division of Endeavor BTV.24:51Thanks very much for tuning in. If you enjoyed today's show, be sure to subscribe to the podcast and share this episode with a colleague who would find it helpful. Until our next episode, you can find us at vision-systems.com or on LinkedIn, Facebook, or X for more insights, updates, and breaking news to keep you in the know. Thanks for tuning in. Until next time, stay focused on your visions.
