Logistic Function In Homomorphic Encryption — A Base for Privacy-Aware Machine Learning
We live in a world where AI can harvest citizen data. But can we find a way that we can learn on encrypted data? Well, with homomorphic encryption we can use encrypted data for our processing. So:
Enc(a operator b) = Enc(a) operator Enc(b)
and where operator could be any mathematical operation. While LLMs are a kinda false type of learning, the usage of artificial neural networks (ANN) allows us the opportunity to learn from data in the same way that our brain works. At the core of this is the logistic function (also known as the sigmoid function):
Mathematically, this is defined as:
For example, if we have x=0.5, then, in Python, we get:
>>> import math
>>> x=0.5
>>> y=1/(1+math.exp(-x))
>>> print (y)
0.6224593312018546
>>> x=6
>>> print (y)
0.9975273768433653
An artificial neural network is created with weighted summation and a sigmoid function: