Deduplication in cloud outsourced data and providing data confidentiality using identity-based encryption

The demand for data storage and processing is increasing at a rapid speed in the big data era. The management of such tremendous volume of data is a critical challenge. Data deduplication technology is an attractive solution to save storage space and traffic in a big data environment. Another challenge in storing data in cloud computing is security issues such as confidentiality and privacy because users put their personal or confidential data in service providers' data centers. Hence, the best solution for providing data confidentiality is encrypting data before they are outsourced to cloud servers. But the problem is that data encryption makes the different cipher-texts from one plaintext, which makes it difficult to distinguish and remove duplicated data. In this research, in order to solve this conflict, a scheme based on identity-based encryption (IBE) will be proposed. The proposed scheme provides the confidentiality of outsourced data from unreliable entities and especially service providers while data deduplication is also possible.