[haza55]

gm_curly is a multi threaded, object orientated, callback based CURL implementation.

It supports in its current form, HTTP, HTTPS and FTP(Get Only)

Magic Definitions

Errors(Not defined in Lua) - http://curl.haxx.se/libcurl/c/libcurl-errors.html
Options(Defined in Lua) - http://curl.haxx.se/libcurl/c/curl_easy_setopt.html

Functions

-- Takes 0:
--     
-- Returns 1:
--     Curly Object
-- Callback none
Curly( )

-- Takes 1:
--     function( CurlyOBJ, errorCode, data )
-- Returns 0:
--     
-- Callback none
Curly:SetCallback( function )

-- Takes 1:
--     bool - false means the data parameter in the callback will always be a string.
--          - true means the data parameter in the callback will be a BinRead object.
-- Returns 0:
--     
-- Callback none
Curly:SetBinaryMode( bool )

-- Takes 1:
--     Url String
-- Returns 1:
--     Error Code - 0 means OK
-- Callback none
Curly:SetUrl( url )

-- Takes 0:
--     
-- Returns 1:
--     Error Code - 0 means OK
-- Callback is called when completed.
Curly:Perform( )

-- Takes 1:
--     Cookie String - "name1=content1; name2=content2;" etc.
-- Returns 1:
--     Error Code - 0 means OK
-- Callback none
Curly:SetCookies( cookies )

-- Takes 2:
--     CURLOPT_*
--     integer value
-- Returns 1:
--     Error Code - 0 means OK
-- Callback none
Curly:SetOptNumber( CURLOPT_*, value )

-- Takes 1:
--     Username String
-- Returns 1:
--     Error Code - 0 means OK
-- Callback none
Curly:SetUsername( username )

-- Takes 1:
--     Password String
-- Returns 1:
--     Error Code - 0 means OK
-- Callback none
Curly:SetPassword( password )

-- Takes 1:
--     Data String - Can contain NULL Characters
-- Returns 1:
--     Error Code - 0 means OK
-- Callback none
Curly:SetPostFields( data )


--------------------------------------------------------------------


-- Takes 0:
--     
-- Returns 1:
--     Returns data size.
-- Callback none
BinRead:GetSize( )

-- Takes 0:
--     
-- Returns 1:
--     Returns the position of the next item to be read.
-- Callback none
BinRead:GetReadPosition( )

-- Takes 0:
--     
-- Returns 1:
--     Returns the Read Position to 0
-- Callback none
BinRead:Rewind( )

-- Takes 0:
--     
-- Returns 1:
--     Reads 1byte, but does not change the Read Position
-- Callback none
BinRead:PeekByte( )

-- Takes 0:
--     
-- Returns 1:
--     Reads 1bytes and returns it as a int.
-- Callback none
BinRead:ReadByte( )

-- Takes 0:
--     
-- Returns 1:
--     Reads 8bytes and returns it as a double.
-- Callback none
BinRead:ReadDouble( )

-- Takes 0:
--     
-- Returns 1:
--     Reads 4bytes and returns it as a int.
-- Callback none
BinRead:ReadInt( )

-- Takes 0:
--     
-- Returns 1:
--     Reads 4bytes and returns it as a float.
-- Callback none
BinRead:ReadFloat( )

-- Takes 0:
--     
-- Returns 1:
--     Reads a NULL terminated string. Read Position will be offset by string.len + 1 (the extra NULL char)
-- Callback none
BinRead:ReadString( )

Basic HTTP connection example.

require("curly")

local curl = Curly()
curl:SetUrl("http://www.google.com/")
curl:SetOptNumber(CURLOPT_FOLLOWLOCATION, 1)
curl:SetCallback(function(curlObj, errorCode, data)
    print(curlObj, "\n", errorCode,"\n")
    Msg(data)
end)
curl:Perform()

Basic HTTPS connection example.

require("curly")

local curl = Curly()
curl:SetUrl("https://www.gmail.com/")
curl:SetOptNumber(CURLOPT_FOLLOWLOCATION, 1)
curl:SetOptNumber(CURLOPT_SSL_VERIFYPEER, 0)
curl:SetOptNumber(CURLOPT_SSL_VERIFYHOST, 1)
curl:SetCallback(function(curlObj, errorCode, data)
    print(curlObj, "\n", errorCode,"\n")
    Msg(data)
end)
curl:Perform()

Some notes.

Only one operation can happen at once on an Curly object.

Once you call Curly:Perform(), you must wait for the the Callback before performing another Curl Query.

All the functions are non-blocking.

Download

Source Code SVN Repo: http://gmod-haza.googlecode.com/svn/trunk/gm_curly/

Windows Binary: http://gmod-haza.googlecode.com/svn/...e/gm_curly.dll

[LuaStoned]

Sweeeet, can't wait to get home :D (~10min)

[Tobba]

Hellyeah!

Ive been waiting for this a long time!

Edited:

This is fucking incridible

[Prefan]

Having FTP upload support would be awesome with this.

[Tobba]

it seems to add double \n though...

[haza55]

Double \n?

Its probally a curl setting.

[Tobba]

Actually no, its my file writing method that dosent accept \r or something

Edited:

Sadly gsub dosent seem to like strings anymore
data:gsub("\r", "")

produce "SK" what the

Edited:

Actually once again: no, its just IBaseFileSystem not liking anything today

[hatred]

Haza, nice module.

Any chance you can do a libmemcache? You seem to be a capable person.

Thanks.

[LuaStoned]

Nevermind, you need the VS2010 Runtime..

[Tobba]

We seriously need the ability to receive NULL's, in the worst case senario could you supply us with some bf_read style function and the ability to get the length so we could assemble the string ourselves for now?

Edited:

Oh nice 1500 posts!

[haza55]

I'm going to add Curly:SetBinaryMode(true), so instead of receiving a string, you will get a bf_read like object. I will also do the same for oosocks.

[Gbps]

haza55 posted:

I'm going to add Curly:SetBinaryMode(true), so instead of receiving a string, you will get a bf_read like object. I will also do the same for oosocks.

Make sure to add a few binary read and write functions too. It's kind of useless without it :S

[haza55]

Added Binary Read Functionality.

[LuaStoned]

haza55 posted:

Added Binary Read Functionality.

Cool stuff, now the serverbrowser/rcon/msn libs will finally get some functionallity :D

€dit: Wanna give us an example?

[Tobba]

Would it be possible to get the size of it so we can assemble the string with string.char?

[haza55]

Tobba posted:

Would it be possible to get the size of it so we can assemble the string with string.char?

Curly:SetBinaryMode(true)
Curly:SetCallback(function(obj, erroCode, binread)
    local size = binread:GetSize()
    local str = ""
    for i=1, size do
        str = str .. string.char(binread:GetByte())
    end
end)

[Tobba]

Ah nice, now we can download zips!

[LuaStoned]

Now we just rely on people and how they set up their addons

[Grocel]

haza55 posted:

Curly:SetBinaryMode(true)
Curly:SetCallback(function(obj, erroCode, binread)
    local size = binread:GetSize()
    local str = ""
    for i=1, size do
        str = str .. string.char(binread:GetByte())
    end
end)

Nice, will you also add this to gm_oosocks soon?

[haza55]

Just did.

[Tobba]

It almost works, it fails on me when i try to download a zip though (probbably a file.Write problem)

[haza55]

You cant write binary data through file.Write

[Tobba]

Obviously your wrong

BECUSE I CAN!

Also would it be possible to decrypt it faster? Currently it lags like hell for a second while it decrypts that binread

Edited:

Apparantly it can only sometimes write NULL's

what the shit(i can download a bz2 that contains nulls but not zips)

Edited:

Actually file.Write didnt like large files

Edited:

Could you make a function that reads a string until NULL, with this we could decode the BinRead without lagging everything to shit

[LuaStoned]

Yeah, something like

local out = {}
for k,part in pairs(data:ReadStr()) do
	table.insert(out,part)
end
write(table.concat(out,"\0"))

[haza55]

Ok.

[Tobba]

I got how that would work, it would be like

local size = data:GetSize()
local str = ""
debug.sethook()
while true do
if data:GetReadPosition() > size then
break
end
str = str..data:ReadString()
end

Edited:

Would be alot faster in most cases inless the file is made out of nulls

Edited:

Actually i got an idea:

BinRead:ToTable()

example:

local str = ""
for k, v in pairs(data:ToTable())
str = str..string.char(v)
end

[haza55]

Ok, Added ReadString to BinRead

[LuaStoned]

Tobba posted:

Actually i got an idea:

BinRead:ToTable()

example:

local str = ""
for k, v in pairs(data:ToTable())
str = str..string.char(v)
end

What no, string concatenation is extremely inefficient compared to table concat...

haza55 posted:

Ok, Added ReadString to BinRead

Thanks.

[Tobba]

Would ToTable be hard to code and/or would it be slow?

[haza55]

Slow. 50k elements, all being bytes would kill it for sure.

[Tobba]

    debug.sethook()
    while true do
        if binread:GetReadPosition() > size then
            break
        end
        table.insert(out,binread:ReadString())
    end
    local str = table.concat(out,"\0")

Froze my game for 20 seconds and then gave me a "out of memory" error in console :ohdear:

[LuaStoned]

Tobba posted:

    debug.sethook()
    while true do
        if binread:GetReadPosition() > size then
            break
        end
        table.insert(out,binread:ReadString())
    end
    local str = table.concat(out,"\0")

Froze my game for 20 seconds and then gave me a "out of memory" error in console :ohdear:

String concatenation, 25.000 times
It took 3.11 seconds to finish!
Table concatenation, 25.000 times
It took 0.02 seconds to finish!

[Tobba]

Must been that loop then

Edited:

    local size = binread:GetSize()
    local out = {}
    debug.sethook()
    while true do
        if binread:GetReadPosition() >= size then
            break
        end
        table.insert(out,binread:ReadString())
    end
    local str = table.concat(out,"\0")
    if binread:GetReadPosition() == size then
        str = str..string.char(binread:ReadByte())
    end

Very fast, but the code isnt very clean

Edited:

When i try to download a zip, 30 bytes is missing (probably file.Write glitchup)

Edited:

Ah yesm file.Write glitch

Edited:

0.00128173828125 seconds to decode 45kb of data

[Grocel]

If file.write doesn't work then try this: http://www.facepunch.com/showthread.php?t=970999
;)

[Tobba]

i got my own function for it, it was just windows being an asshole becuse i didnt open the file in binary mode

[Trivkz]

Error report:

Lua: error loading module 'curly' from file 'c:\program files\steam\steamapps\*******\garrysmod\garrysmod\ lua\includes\modules\gm_curly.dll':
Det angivne modul blev ikke fundet.

Windows 7
32 bit
Need more info?

[Tobba]

get the VC++ 2010 runtime package

[Trivkz]

Tobba posted:

get the VC++ 2010 runtime package

Right, that worked. Thanks

[haza55]

Updated DLL to use msvc 2008 dependencies.