Unraveling GenAI: Ethical Dilemmas in the Evolving Enterprise Landscape with Sid Banerjee

GenAI has many connotations. Some people almost think it is like a silver bullet, that it will solve every problem they have. Equally, some people are so skeptical about it, thinking it is just a phenomenon that will come and go, leaving them untouched. In my opinion, both views are wrong. It will have its usage and a huge impact on the way people work. It will force people to reinvent themselves. But at the same time, it will not solve every problem, nor will it fail to address many issues we have today. All its answers are going to be flawed. So, we are somewhere in the middle where it is going to be a horses-for-courses strategy that people will follow when it comes to GenAI.

Speaking of organizations, I am reminded of Marshall Goldsmith’s book, which talks about what got you here will not get you there. Every organization will have to think about it like that. What they have been practicing to do a bunch of things tomorrow may have to be done differently because the client’s expectations are going to change, as will the expectations of every stakeholder. The way people ingest data is also going to change, and in that evolving dynamic, it is going to force almost every organization to take it very seriously and go down this path. But how it will impact each of them is something that all of us will see in the next 12 months.

There is no one-size-fits-all for GenAI. It will vary not just for the specific industries that we are talking about. It will also depend on which functions or horizontals of that industry are going to deploy GenAI. An example is within banking, the way a risk function will look at GenAI will be very different from the way sales and trading will look at GenAI. Equally, the way banks will look at GenAI will be very different from how a media company will look at GenAI. So the use cases are phenomenal. The opportunities of GenAI could also be exponential. But it is like one of those toys that we have played with or the tools that you use, which, if not rightly used, can lead to a lot of disturbance and disruption in the system that may almost force you to go back twenty steps instead of going forward 10 steps. So it needs careful consideration before it is implemented. And it also needs a very thought-through application of GenAI, both from a use case standpoint as well as its output and delivery aspects.

You make a very good point in terms of the ethical concerns, very relevant also from an SGA standpoint because we give it paramount importance in whatever we do, as we believe that life is possible. From that context, I would say the three things that really worry people dealing with Generative AI, and more importantly, those deploying GenAI are: Is it fair? Is it expandable or scalable? And lastly, is it reliable?

Why are these three important? Because when a lot of this is done by the machine and using terabytes of data from all sources, it becomes very challenging for anybody using this to be comfortable with these three points. The fairness obviously comes because a lot of this is dependent on historical data. And when you deal with historical data, many times the world has moved, circumstances have changed, and parameters have changed. Therefore, what has happened in the past will not necessarily happen in the future. It is not going to be reflective of the past, so the patterns. That needs to be considered.

Equally, when we talk about expandable or scalability, many of them, you are looking at a dataset that may not be a good representation of the rest of the dataset. And when it talks about reliability, then it’s a question of how the data has been interpreted by the system. Interpretation is, again, of great importance. So this is where I feel there is a need to be very aware of this and therefore bring in an element of curation of these models by a human interface, and not just deploy exactly what is being thrown out by the machine. And that is a sweet spot, which I think as a firm we are trying to address.

Let me share with you what I exactly see in this space in my conversations with CXOs of large organizations. There is a terrific pressure coming to the organization’s CEOs and CXOs from their board, where they want to see the benefits of GenAI. They want the organization to adopt it; they are hearing a lot about it and they’re asking the question on how these organizations are embracing it.

But equally, when people at the leadership level are talking about GenAI, they are themselves very careful of ensuring that they do not go down the wrong path in terms of deploying GenAI because it can get you a lot of bad press in the event it goes off the handle.

So, I am actually observing opportunities for firms like SG Analytics here, where companies who have a certain use case or a problem statement are coming and discussing that with us. And once we incubate that conversation within our framework and see the success of it before they want to bring it back to the system and scale it up.
So that’s one immediate opportunity as well as a phenomenon that I’m seeing in the market.

It’s good you’re asking that question to a company that is very passionate about ESG, encompassing both the social and community aspects. This is something that worries us as well. So let me approach it in three aspects. One is the impact of this on intellectual property rights. The second could be in terms of the impact on the organizational standpoint, and third, on the social and community standpoint.

Let’s look at deploying this in an area like the European Union, where GDPR is such a big concern. The European Union has signed up for GDPR, stating that no personal data should come out of Europe, if at all. So, you need to anonymize the data, mask the data, bring it out, and again, de-anonymize and bring it back. Given that sort of scenario, it becomes very restrictive for that market. And we have to be very careful if we have to deploy any of those. As a result of which, today, we have started an office in Wroclaw in Poland because we do not want the European data to come out of that.
On the intellectual property side, when GenAI gets into managing this data and gaining insights, one has to be very careful in terms of potential patent or copyright violations in the process. Sometimes violations get morphed into the output without immediate awareness, until someone points it out.

Equally, from an organizational impact perspective, there’s standard chatter that this will have a significant impact on certain job sectors, which is a little premature for us to draw any conclusions. But it is creating some sort of panic within the system, questioning whether certain jobs or organizations will become redundant. These conversations are premature. We haven’t seen the full breadth of its output.

The same applies to the social and community side. Some people think this will lead to more carbon emissions, or that it may produce information and insights that could harm certain communities or their prospects. I believe this perspective is quite misplaced. With increased awareness and the presence of more watchdogs and governing bodies, I think they will certainly implement the right restrictions and regulations to prevent any misplacement.

This reminds me of the old adage “That fire is a good servant, but a bad master.” GenAI kind of fits into the same place. Left to wrong hands and left for the wrong purpose, it can have a disastrous effect. So I definitely believe that it is important to understand the right use case for this and use it in a manner which will make life possible as we talked about in SG. It will improve life, it will reduce the gap between the privileged and the underprivileged and it will make life much more beautiful if I may use the word. As against the concern about the whole disruption that will create something very similar to what we saw when initially automation came into play in late 80s and early 90s.
So overall, I think GenAI is going to be a game changer. But it would need to be driven from the top. And that’s one of the reasons why from an SGA standpoint, I relocated myself as CEO of the company into the US as you are seeing that I am right now sitting in New York. And I want to engage with the CXOs of large transnational companies and work with them and talk through and drive these issues with much more impact and effectiveness and really make a difference in the way people will look at GenAI in the future.