Backend Development
Golang
How to optimize the performance of large number of image link replacements using Golang?
How to optimize the performance of large number of image link replacements using Golang?
Apr 02, 2025 pm 12:12 PM
This article discusses how to optimize Golang code and efficiently handle large-scale image link replacement, especially for scenarios where images are uploaded to Alibaba Cloud OSS and replaced the original link. Performance bottlenecks are often frequent network requests and resource creation.
Assume that the initial string contains multiple image links:
<code>content := `<img class="wscnph lazy" src="/static/imghw/default1.png" data-src="https://img.php.cn/upload/article/001/246/273/174278558460021.jpg" alt="How to optimize the performance of large number of image link replacements using Golang?" ><img class="wscnph lazy" src="/static/imghw/default1.png" data-src="https://img.php.cn/upload/article/001/246/273/174278558769141.jpg" alt="How to optimize the performance of large number of image link replacements using Golang?" > `</code>
We need to match the link, upload it to OSS, and replace the original link. The original code has performance problems, which are mainly reflected in the repeated creation of OSS clients and blocking uploads.
For optimization, we will adopt the following strategies:
Singleton OSS client: Use
sync.Onceto ensure thatoss.Newis executed only once, avoiding repeated creation of OSS client instances.Concurrent upload: Use
goroutineto upload images concurrently to OSS to avoid blocking the main thread.Caching mechanism (optional): Introduce caches (such as
sync.Map) to store old and new link mappings of uploaded images to avoid repeated uploads of the same images.
The improved code is as follows:
package main
import (
"bytes"
"fmt"
"regexp"
"strconv"
"strings"
"sync"
"time"
"github.com/aliyun/aliyun-oss-go-sdk/oss"
)
// ... (Aliyun OSS configuration: Endpoint, key, AccessKeySecret, BucketName) ...
var (
ossClient *oss.Client
once sync.Once
imgCache sync.Map // key: old URL, value: new URL
)
func getOSSClient() *oss.Client {
once.Do(func() {
client, err := oss.New(Endpoint, key, AccessKeySecret)
if err != nil {
panic(err) // Handle error appropriately in production
}
ossClient = client
})
return ossClient
}
func Upload(url string) (string, error) {
client := getOSSClient()
bucket, err := client.Bucket(BucketName)
if err != nil {
return "", err
}
t1 := time.Now().Unix()
long := 0 // Simplified counter, consider a more robust solution
obj := fmt.Sprintf("article/%d%d.png", t1, long)
err = bucket.PutObject(obj, bytes.NewReader(ReadImgData(url))) // ReadImgData function assumed to exist
if err != nil {
return "", err
}
return "https://" BucketName "." Endpoint "/" obj, nil
}
func RepImages(htmls string) string {
var imgRE = regexp.MustCompile(`<img alt="How to optimize the performance of large number of image link replacements using Golang?" > ]*src=["']([^"'] )["'][^>]*>`) // Improved regex
imgs := imgRE.FindAllStringSubmatch(htmls, -1)
var wg sync.WaitGroup
resultChan := make(chan string, len(imgs))
for _, img := range imgs {
if len(img) > 1 {
oldURL := img[1]
if newURL, ok := imgCache.Load(oldURL); ok {
resultChan <img class="wscnph lazy" src="/static/imghw/default1.png" data-src="https://img.php.cn/upload/article/001/246/273/174278558769141.jpg" alt="How to optimize the performance of large number of image link replacements using Golang?" > `
fmt.Println(RepImages(content))
}
// Placeholder for the actual image reading function
func ReadImgData(url string) []byte {
// Replace this with your actual image reading logic
// ...
return []byte("image data")
}
Remember to replace Endpoint , key , AccessKeySecret , and BucketName for your Alibaba Cloud OSS configuration. ReadImgData function needs to be implemented according to your actual situation. This improved version utilizes concurrency and caching, significantly improving the efficiency of handling large number of image links. Error handling has also been strengthened to avoid program crashes. The caching mechanism can be further optimized, such as using LRU caching policies to manage memory usage.
The above is the detailed content of How to optimize the performance of large number of image link replacements using Golang?. For more information, please follow other related articles on the PHP Chinese website!
Hot AI Tools
Undress AI Tool
Undress images for free
Undresser.AI Undress
AI-powered app for creating realistic nude photos
AI Clothes Remover
Online AI tool for removing clothes from photos.
Clothoff.io
AI clothes remover
Video Face Swap
Swap faces in any video effortlessly with our completely free AI face swap tool!
Hot Article
Hot Tools
Notepad++7.3.1
Easy-to-use and free code editor
SublimeText3 Chinese version
Chinese version, very easy to use
Zend Studio 13.0.1
Powerful PHP integrated development environment
Dreamweaver CS6
Visual web development tools
SublimeText3 Mac version
God-level code editing software (SublimeText3)
Hot Topics
The top 10 most authoritative cryptocurrency market websites in the world (the latest version of 2025)
Jul 29, 2025 pm 12:48 PM
The top ten authoritative cryptocurrency market and data analysis platforms in 2025 are: 1. CoinMarketCap, providing comprehensive market capitalization rankings and basic market data; 2. CoinGecko, providing multi-dimensional project evaluation with independence and trust scores; 3. TradingView, having the most professional K-line charts and technical analysis tools; 4. Binance market, providing the most direct real-time data as the largest exchange; 5. Ouyi market, highlighting key derivative indicators such as position volume and capital rate; 6. Glassnode, focusing on on-chain data such as active addresses and giant whale trends; 7. Messari, providing institutional-level research reports and strict standardized data; 8. CryptoCompa
How to choose a free market website in the currency circle? The most comprehensive review in 2025
Jul 29, 2025 pm 06:36 PM
The most suitable tools for querying stablecoin markets in 2025 are: 1. Binance, with authoritative data and rich trading pairs, and integrated TradingView charts suitable for technical analysis; 2. Ouyi, with clear interface and strong functional integration, and supports one-stop operation of Web3 accounts and DeFi; 3. CoinMarketCap, with many currencies, and the stablecoin sector can view market value rankings and deans; 4. CoinGecko, with comprehensive data dimensions, provides trust scores and community activity indicators, and has a neutral position; 5. Huobi (HTX), with stable market conditions and friendly operations, suitable for mainstream asset inquiries; 6. Gate.io, with the fastest collection of new coins and niche currencies, and is the first choice for projects to explore potential; 7. Tra
What is a stablecoin? Understand stablecoins in one article!
Jul 29, 2025 pm 01:03 PM
Stablecoins are cryptocurrencies with value anchored by fiat currency or commodities, designed to solve price fluctuations such as Bitcoin. Their importance is reflected in their role as a hedging tool, a medium of trading and a bridge connecting fiat currency with the crypto world. 1. The fiat-collateralized stablecoins are fully supported by fiat currencies such as the US dollar. The advantage is that the mechanism is simple and stable. The disadvantage is that they rely on the trust of centralized institutions. They represent the projects including USDT and USDC; 2. The cryptocurrency-collateralized stablecoins are issued through over-collateralized mainstream crypto assets. The advantages are decentralization and transparency. The disadvantage is that they face liquidation risks. The representative project is DAI. 3. The algorithmic stablecoins rely on the algorithm to adjust supply and demand to maintain price stability. The advantages are that they do not need to be collateral and have high capital efficiency. The disadvantage is that the mechanism is complex and the risk is high. There have been cases of dean-anchor collapse. They are still under investigation.
Ethena treasury strategy: the rise of the third empire of stablecoin
Jul 30, 2025 pm 08:12 PM
The real use of battle royale in the dual currency system has not yet happened. Conclusion In August 2023, the MakerDAO ecological lending protocol Spark gave an annualized return of $DAI8%. Then Sun Chi entered in batches, investing a total of 230,000 $stETH, accounting for more than 15% of Spark's deposits, forcing MakerDAO to make an emergency proposal to lower the interest rate to 5%. MakerDAO's original intention was to "subsidize" the usage rate of $DAI, almost becoming Justin Sun's Solo Yield. July 2025, Ethe
What is Binance Treehouse (TREE Coin)? Overview of the upcoming Treehouse project, analysis of token economy and future development
Jul 30, 2025 pm 10:03 PM
What is Treehouse(TREE)? How does Treehouse (TREE) work? Treehouse Products tETHDOR - Decentralized Quotation Rate GoNuts Points System Treehouse Highlights TREE Tokens and Token Economics Overview of the Third Quarter of 2025 Roadmap Development Team, Investors and Partners Treehouse Founding Team Investment Fund Partner Summary As DeFi continues to expand, the demand for fixed income products is growing, and its role is similar to the role of bonds in traditional financial markets. However, building on blockchain
Ethereum (ETH) NFT sold nearly $160 million in seven days, and lenders launched unsecured crypto loans with World ID
Jul 30, 2025 pm 10:06 PM
Table of Contents Crypto Market Panoramic Nugget Popular Token VINEVine (114.79%, Circular Market Value of US$144 million) ZORAZora (16.46%, Circular Market Value of US$290 million) NAVXNAVIProtocol (10.36%, Circular Market Value of US$35.7624 million) Alpha interprets the NFT sales on Ethereum chain in the past seven days, and CryptoPunks ranked first in the decentralized prover network Succinct launched the Succinct Foundation, which may be the token TGE
What is Ethereum? What are the ways to obtain Ethereum ETH?
Jul 31, 2025 pm 11:00 PM
Ethereum is a decentralized application platform based on smart contracts, and its native token ETH can be obtained in a variety of ways. 1. Register an account through centralized platforms such as Binance and Ouyiok, complete KYC certification and purchase ETH with stablecoins; 2. Connect to digital storage through decentralized platforms, and directly exchange ETH with stablecoins or other tokens; 3. Participate in network pledge, and you can choose independent pledge (requires 32 ETH), liquid pledge services or one-click pledge on the centralized platform to obtain rewards; 4. Earn ETH by providing services to Web3 projects, completing tasks or obtaining airdrops. It is recommended that beginners start from mainstream centralized platforms, gradually transition to decentralized methods, and always attach importance to asset security and independent research, to
There is only one kind of person who makes money in the currency circle
Jul 29, 2025 pm 03:24 PM
What can truly make money stably is countercyclical traders with anti-human characteristics. 1. They identify whales in the market FOMO by fighting emotional kidnapping, and capture wrongly killed assets when panic sell-offs; 2. Establish mechanized trading discipline and strictly implement stop-profit and stop-loss rules to fight greed and fear; 3. Use cognitive arbitrage thinking to discover institutional trends and trend opportunities in advance through on-chain data and code updates and other underlying information, and ultimately solidify emotional isolation, data decision-making and countercyclical operations into trading instincts, thereby continuing to make profits in the encrypted market with amplified human nature.
